Sep 18 00:42:29 devstack cinder-volume[76407]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76407) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 00:42:29 devstack cinder-volume[76407]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76407) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 00:42:29 devstack cinder-volume[76407]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76407) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 00:42:31 devstack cinder-volume[76407]: INFO dbcounter [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Registered counter for database cinder
Sep 18 00:42:31 devstack cinder-volume[76407]: DEBUG oslo_db.sqlalchemy.engines [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 00:42:31 devstack cinder-volume[76407]: DEBUG dbcounter [-] [76407] Writer thread running {{(pid=76407) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 00:42:31 devstack cinder-volume[76407]: INFO cinder.rpc [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 18 00:42:31 devstack cinder-volume[76407]: INFO cinder.rpc [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 18 00:42:31 devstack cinder-volume[76407]: DEBUG oslo_db.sqlalchemy.engines [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 00:42:31 devstack cinder-volume[76407]: INFO cinder.volume.manager [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Determined volume DB was empty at startup.
Sep 18 00:42:31 devstack cinder-volume[76407]: DEBUG cinder.volume.manager [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76407) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 18 00:42:31 devstack cinder-volume[76407]: INFO cinder.volume.manager [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 18 00:42:31 devstack cinder-volume[76407]: WARNING stevedore.named [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 18 00:42:31 devstack cinder-volume[76407]: WARNING castellan.key_manager [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 00:42:31 devstack cinder-volume[76407]: WARNING cinder.keymgr.conf_key_mgr [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 00:42:31 devstack cinder-volume[76407]: DEBUG cinder.volume.drivers.lvm [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76407) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 18 00:42:31 devstack cinder-volume[76407]: DEBUG oslo_concurrency.processutils [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:32 devstack cinder-volume[76407]: DEBUG oslo_concurrency.processutils [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] CMD "cinder-rtstool verify" returned: 0 in 0.922s {{(pid=76407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_db.sqlalchemy.engines [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 00:42:33 devstack cinder-volume[76407]: INFO cinder.rpc [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 18 00:42:33 devstack cinder-volume[76407]: INFO cinder.rpc [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 18 00:42:33 devstack cinder-volume[76407]: WARNING stevedore.named [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 18 00:42:33 devstack cinder-volume[76407]: WARNING castellan.key_manager [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 00:42:33 devstack cinder-volume[76407]: INFO cinder.volume.manager [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_db.sqlalchemy.engines [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 00:42:33 devstack cinder-volume[76407]: INFO oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Starting 1 workers
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Started child 76559 {{(pid=76407) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Full set of CONF: {{(pid=76407) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] ******************************************************************************** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Configuration options gathered from: {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] ================================================================================ {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] allow_availability_zone_fallback = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] allow_compression_on_image_upload = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] allowed_direct_url_schemes     = [] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] api_rate_limit                 = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] auth_strategy                  = keystone {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] az_cache_duration              = 3600 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_availability_zone      = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_host                   = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_name                   = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_stats_polling_interval = 60 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backup_api_class               = cinder.backup.api.API {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backup_name_template           = backup-%s {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backup_use_same_host           = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backup_use_temp_snapshot       = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] chap_password                  = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] chap_username                  =  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76559]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cinder_internal_tenant_project_id = d9a57c51f7f147ef83704d9bfee7ce84 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cinder_internal_tenant_user_id = 69ac5d70d4f548119b5846f142d26bff {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cloned_volume_same_az          = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cluster                        = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] compression_format             = gzip {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] config_dir                     = [] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] config_source                  = [] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] control_exchange               = openstack {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] debug                          = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] default_availability_zone      = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] default_group_type             = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] default_volume_type            = lvmdriver-1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] driver_client_cert             = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] driver_client_cert_key         = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] driver_data_namespace          = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] driver_ssl_cert_path           = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] driver_ssl_cert_verify         = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] driver_use_ssl                 = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] enable_force_upload            = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] enable_new_services            = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] enable_unsupported_driver      = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] enforce_multipath_for_image_xfer = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] filter_function                = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance_api_insecure            = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance_api_servers             = ['http://192.168.122.180/image'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance_api_ssl_compression     = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance_ca_certificates_file    = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance_certfile                = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance_keyfile                 = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance_num_retries             = 3 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance_request_timeout         = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] goodness_function              = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] graceful_shutdown_timeout      = 5 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] group_api_class                = cinder.group.api.API {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] host                           = devstack {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] image_compress_on_upload       = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] image_conversion_address_space_limit = 1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] image_conversion_cpu_limit     = 60 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] image_conversion_disable       = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] image_upload_use_cinder_backend = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] image_upload_use_internal_tenant = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] image_volume_cache_enabled     = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] image_volume_cache_max_count   = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] image_volume_cache_max_size_gb = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] init_host_max_objects_retrieval = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] iscsi_iotype                   = fileio {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] iscsi_target_flags             =  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] iscsi_write_cache              = on {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] iser_helper                    = tgtadm {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] iser_ip_address                = 192.168.122.180 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] iser_port                      = 3260 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] log_color                      = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] log_config_append              = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] log_dir                        = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] log_file                       = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] log_options                    = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] log_rotate_interval            = 1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] log_rotate_interval_type       = days {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] log_rotation_type              = none {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] max_age                        = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] max_logfile_count              = 30 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] max_logfile_size_mb            = 200 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] max_over_subscription_ratio    = 20.0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] message_reap_interval          = 86400 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] message_ttl                    = 2592000 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] migration_create_volume_timeout_secs = 300 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] monkey_patch                   = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] monkey_patch_modules           = [] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] my_ip                          = 192.168.122.180 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] no_snapshot_gb_quota           = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] num_iser_scan_tries            = 3 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] num_shell_tries                = 3 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] num_volume_device_scan_tries   = 3 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] nvmeof_conn_info_version       = 1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] nvmet_ns_id                    = 10 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] nvmet_port_id                  = 1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] osapi_max_limit                = 1000 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] osapi_volume_ext_list          = [] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] osapi_volume_listen_port       = 8776 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] osapi_volume_use_ssl           = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] osapi_volume_workers           = 2 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] per_volume_size_limit          = -1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] periodic_fuzzy_delay           = 60 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] periodic_interval              = 60 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] public_endpoint                = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] publish_errors                 = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] quota_backup_gigabytes         = 1000 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] quota_backups                  = 10 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] quota_gigabytes                = 1000 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] quota_groups                   = 10 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] quota_snapshots                = 10 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] quota_volumes                  = 10 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] rate_limit_burst               = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] rate_limit_except_level        = CRITICAL {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] rate_limit_interval            = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] reinit_driver_count            = 3 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] replication_device             = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] report_discard_supported       = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] report_interval                = 120 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] reservation_clean_interval     = 86400 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] reservation_expire             = 86400 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] reserved_image_namespaces      = [] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] reserved_percentage            = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] rpc_response_timeout           = 120 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] run_external_periodic_tasks    = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] scst_target_driver             = iscsi {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] scst_target_iqn_name           = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] service_down_time              = 720 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] shell_completion               = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] snapshot_name_template         = snapshot-%s {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] snapshot_same_host             = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] split_loggers                  = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] state_path                     = /opt/stack/data/cinder {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] storage_availability_zone      = nova {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] storage_protocol               = iSCSI {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] syslog_log_facility            = LOG_USER {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] target_helper                  = lioadm {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] target_ip_address              = 192.168.122.180 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] target_port                    = 3260 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] target_protocol                = iscsi {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] target_secondary_ip_addresses  = [] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] trace_flags                    = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] transport_url                  = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] until_refresh                  = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] use_chap_auth                  = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] use_default_quota_class        = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] use_journal                    = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] use_json                       = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] use_multipath_for_image_xfer   = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] use_stderr                     = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] use_syslog                     = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] verify_glance_signatures       = enabled {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] volume_api_class               = cinder.volume.api.API {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] volume_backend_name            = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] volume_clear                   = zero {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] volume_clear_ionice            = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] volume_clear_size              = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] volume_copy_bps_limit          = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] volume_dd_blocksize            = 1M {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] volume_name_template           = volume-%s {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] volume_service_inithost_offload = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] volume_usage_audit_period      = month {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] watch_log_file                 = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] zoning_mode                    = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_concurrency.disable_process_locking = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.admin_password = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.admin_token = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.admin_user  = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.auth_port   = 35357 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.auth_protocol = https {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.auth_section = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.auth_type   = password {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.auth_uri    = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.auth_version = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.cache       = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.certfile    = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.identity_uri = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.include_service_catalog = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.insecure    = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.interface   = public {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.keyfile     = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_password =  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76559]: INFO cinder.volume.manager [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcache_username =  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.region_name = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.service_token_roles_required = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.service_type = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.backend                  = dogpile.cache.null {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.backend_argument         = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.backend_expiration_time  = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.config_prefix            = cache.oslo {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.dead_timeout             = 60.0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.debug_cache_backend      = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.enable_retry_client      = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.enable_socket_keepalive  = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.enabled                  = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.enforce_fips_mode        = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.expiration_time          = 600 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.hashclient_retry_attempts = 2 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.memcache_dead_retry      = 300 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.memcache_password        = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.memcache_sasl_enabled    = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.memcache_username        = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.proxies                  = [] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.redis_db                 = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.redis_password           = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.redis_server             = localhost:6379 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.redis_socket_timeout     = 1.0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.redis_username           = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.retry_attempts           = 2 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.retry_delay              = 0.0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.socket_keepalive_count   = 1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.socket_keepalive_idle    = 1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.socket_keepalive_interval = 1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.tls_allowed_ciphers      = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.tls_cafile               = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.tls_certfile             = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.tls_enabled              = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cache.tls_keyfile              = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] coordination.backend_url       = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.asyncio_connection    = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.asyncio_slave_connection = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.backend               = sqlalchemy {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.connection            = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.connection_debug      = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.connection_parameters =  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.connection_recycle_time = 3600 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.connection_trace      = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.db_inc_retry_interval = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.db_max_retries        = 20 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.db_max_retry_interval = 10 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.db_retry_interval     = 1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.max_overflow          = 50 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.max_pool_size         = 5 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.max_retries           = 10 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.mysql_wsrep_sync_wait = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.pool_timeout          = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.retry_interval        = 10 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.slave_connection      = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.sqlite_synchronous    = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] database.use_db_reconnect      = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] profiler.connection_string     = messaging:// {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] profiler.enabled               = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] profiler.es_doc_type           = notification {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] profiler.es_scroll_size        = 10000 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] profiler.es_scroll_time        = 2m {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] profiler.filter_error_trace    = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] profiler.hmac_keys             = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] profiler.sentinel_service_name = mymaster {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] profiler.socket_timeout        = 0.1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] profiler.trace_requests        = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] profiler.trace_sqlalchemy      = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] profiler_jaeger.process_tags   = {} {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] profiler_jaeger.service_name_prefix = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] profiler_otlp.service_name_prefix = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_policy.enforce_new_defaults = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: WARNING oslo_config.cfg [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_policy.enforce_scope      = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_policy.policy_default_rule = default {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] privsep_osbrick.group          = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] privsep_osbrick.helper_command = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] privsep_osbrick.user           = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cinder_sys_admin.group         = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cinder_sys_admin.helper_command = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] cinder_sys_admin.user          = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] service_user.auth_section      = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] service_user.auth_type         = password {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] service_user.certfile          = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] service_user.collect_timing    = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] service_user.insecure          = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] service_user.keyfile           = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] service_user.send_service_user_token = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] service_user.split_loggers     = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] service_user.timeout           = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance.auth_section            = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance.auth_type               = password {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance.certfile                = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance.collect_timing          = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance.insecure                = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance.keyfile                 = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance.split_loggers           = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] glance.timeout                 = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.backend_availability_zone = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.chap_password = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.chap_username =  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.driver_client_cert = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.driver_client_cert_key = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.driver_data_namespace = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.152s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.driver_use_ssl = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.extra_capabilities = {} {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.filter_function = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.goodness_function = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.iscsi_target_flags =  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.iscsi_write_cache = on {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.iser_ip_address = 192.168.122.180 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.iser_port     = 3260 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.lvm_share_target = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.lvm_type      = auto {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:33 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.num_shell_tries = 3 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.replication_device = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.report_discard_supported = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.reserved_percentage = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.target_helper = tgtadm {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.target_ip_address = 192.168.122.180 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.target_port   = 3260 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.target_protocol = iscsi {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.trace_flags   = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.unique_fqdn_network = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.use_chap_auth = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.volume_backend_name = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.volume_clear  = zero {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.volume_clear_ionice = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.volume_clear_size = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_reports.file_event_handler = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_reports.log_dir           = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.backend_host       = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.chap_password      = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.chap_username      = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.driver_client_cert = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.extra_capabilities = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.filter_function    = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.goodness_function  = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.iscsi_iotype       = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.iser_helper        = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.iser_port          = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.lvm_type           = auto {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.replication_device = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.report_discard_supported = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.reserved_percentage = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.scst_target_driver = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.storage_protocol   = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.target_ip_address  = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.target_port        = 3260 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.trace_flags        = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.volume_clear       = zero {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] lvmdriver-1.volumes_dir        = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_notifications.driver = [] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_notifications.retry = -1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] key_manager.fixed_key          = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.barbican_api_version  = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.barbican_endpoint     = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.barbican_endpoint_type = public {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.barbican_region_name  = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.cafile                = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.certfile              = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.collect_timing        = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.insecure              = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.keyfile               = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.number_of_retries     = 60 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.retry_delay           = 1 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.send_service_user_token = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.split_loggers         = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.timeout               = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.verify_ssl            = True {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican.verify_ssl_path       = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican_service_user.auth_section = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican_service_user.auth_type = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican_service_user.cafile   = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican_service_user.certfile = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican_service_user.collect_timing = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican_service_user.insecure = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican_service_user.keyfile  = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican_service_user.split_loggers = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] barbican_service_user.timeout  = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] vault.approle_role_id          = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] vault.approle_secret_id        = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] vault.kv_mountpoint            = secret {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] vault.kv_path                  = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] vault.kv_version               = 2 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] vault.namespace                = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] vault.root_token_id            = **** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] vault.ssl_ca_crt_file          = None {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] vault.timeout                  = 60.0 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] vault.use_ssl                  = False {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:42:34 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] ******************************************************************************** {{(pid=76407) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 18 00:42:34 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.160s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:34 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:34 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.089s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:34 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:34 devstack sudo[76605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 18 00:42:34 devstack sudo[76605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:42:36 devstack sudo[76605]: pam_unix(sudo:session): session closed for user root
Sep 18 00:42:36 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 1.975s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:36 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:36 devstack sudo[76719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 00:42:36 devstack sudo[76719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:42:38 devstack sudo[76719]: pam_unix(sudo:session): session closed for user root
Sep 18 00:42:38 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.942s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:38 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 00:42:38 devstack cinder-volume[76559]: INFO cinder.brick.local_dev.lvm [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 18 00:42:38 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:38 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.087s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:38 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:38 devstack sudo[76819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 00:42:38 devstack sudo[76819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:42:40 devstack sudo[76819]: pam_unix(sudo:session): session closed for user root
Sep 18 00:42:40 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.969s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:40 devstack cinder-volume[76559]: DEBUG cinder.brick.local_dev.lvm [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76559) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 18 00:42:40 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:40 devstack sudo[76908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 00:42:40 devstack sudo[76908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:42:43 devstack cinder-volume[76407]: DEBUG dbcounter [-] [76407] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76407) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:42:43 devstack sudo[76908]: pam_unix(sudo:session): session closed for user root
Sep 18 00:42:43 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.591s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:43 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:44 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.134s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:44 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:44 devstack sudo[77106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 00:42:44 devstack sudo[77106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:42:46 devstack sudo[77106]: pam_unix(sudo:session): session closed for user root
Sep 18 00:42:46 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.028s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:46 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:46 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.085s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:46 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:46 devstack sudo[77143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 18 00:42:46 devstack sudo[77143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:42:48 devstack sudo[77143]: pam_unix(sudo:session): session closed for user root
Sep 18 00:42:48 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.028s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:48 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:48 devstack sudo[77174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 00:42:48 devstack sudo[77174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:42:51 devstack sudo[77174]: pam_unix(sudo:session): session closed for user root
Sep 18 00:42:51 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.860s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:51 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:51 devstack sudo[77235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 00:42:51 devstack sudo[77235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:42:54 devstack sudo[77235]: pam_unix(sudo:session): session closed for user root
Sep 18 00:42:54 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.787s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:54 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:54 devstack sudo[77240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:42:54 devstack sudo[77240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:42:56 devstack sudo[77240]: pam_unix(sudo:session): session closed for user root
Sep 18 00:42:56 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.768s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:56 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:57 devstack sudo[77245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 00:42:57 devstack sudo[77245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:42:59 devstack sudo[77245]: pam_unix(sudo:session): session closed for user root
Sep 18 00:42:59 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.482s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:59 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:59 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.142s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:42:59 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:42:59 devstack sudo[77257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 00:42:59 devstack sudo[77257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:43:01 devstack sudo[77257]: pam_unix(sudo:session): session closed for user root
Sep 18 00:43:01 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.170s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:01 devstack cinder-volume[76559]: INFO cinder.volume.drivers.lvm [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 18 00:43:01 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:43:01 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.067s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:01 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:43:02 devstack sudo[77370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 00:43:02 devstack sudo[77370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:43:03 devstack sudo[77370]: pam_unix(sudo:session): session closed for user root
Sep 18 00:43:03 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.879s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:03 devstack cinder-volume[76559]: DEBUG cinder.volume.drivers.lvm [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Updating volume stats {{(pid=76559) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 00:43:03 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:43:03 devstack sudo[77475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 00:43:03 devstack sudo[77475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:43:05 devstack sudo[77475]: pam_unix(sudo:session): session closed for user root
Sep 18 00:43:05 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.949s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:05 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:43:05 devstack sudo[77515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:43:05 devstack sudo[77515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:43:07 devstack sudo[77515]: pam_unix(sudo:session): session closed for user root
Sep 18 00:43:07 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.925s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:07 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:43:07 devstack sudo[77519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 00:43:07 devstack sudo[77519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:43:09 devstack sudo[77519]: pam_unix(sudo:session): session closed for user root
Sep 18 00:43:09 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.891s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:09 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:43:09 devstack sudo[77524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:43:09 devstack sudo[77524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:43:11 devstack sudo[77524]: pam_unix(sudo:session): session closed for user root
Sep 18 00:43:11 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.933s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:11 devstack cinder-volume[76559]: INFO cinder.volume.driver [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Driver hasn't implemented _init_vendor_properties()
Sep 18 00:43:11 devstack cinder-volume[76559]: DEBUG cinder.volume.driver [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76559) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 18 00:43:11 devstack cinder-volume[76559]: DEBUG oslo_db.sqlalchemy.engines [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76559) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 00:43:11 devstack cinder-volume[76559]: DEBUG dbcounter [-] [76559] Writer thread running {{(pid=76559) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 00:43:11 devstack cinder-volume[76559]: DEBUG cinder.db.sqlalchemy.api [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Building query based on filter {{(pid=76559) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 18 00:43:12 devstack cinder-volume[76559]: DEBUG cinder.image.image_utils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76559) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 18 00:43:12 devstack cinder-volume[76559]: INFO cinder.keymgr.migration [None req-1d6dddac-300c-423c-aa6e-c1ecde4b8199 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 18 00:43:12 devstack cinder-volume[76559]: DEBUG cinder.volume.drivers.lvm [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Updating volume stats {{(pid=76559) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 00:43:12 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:43:12 devstack sudo[77532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 00:43:12 devstack sudo[77532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:43:14 devstack sudo[77532]: pam_unix(sudo:session): session closed for user root
Sep 18 00:43:14 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.980s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:14 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:43:14 devstack sudo[77643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:43:14 devstack sudo[77643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:43:16 devstack sudo[77643]: pam_unix(sudo:session): session closed for user root
Sep 18 00:43:16 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.993s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:16 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:43:16 devstack sudo[77682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 00:43:16 devstack sudo[77682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:43:18 devstack sudo[77682]: pam_unix(sudo:session): session closed for user root
Sep 18 00:43:18 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.186s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:18 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:43:18 devstack sudo[77716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:43:18 devstack sudo[77716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:43:20 devstack sudo[77716]: pam_unix(sudo:session): session closed for user root
Sep 18 00:43:20 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.755s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:20 devstack cinder-volume[76559]: DEBUG cinder.manager [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Notifying Schedulers of capabilities ... {{(pid=76559) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:43:20 devstack cinder-volume[76559]: INFO cinder.volume.manager [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Driver initialization completed successfully.
Sep 18 00:43:20 devstack cinder-volume[76559]: INFO cinder.manager [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Initiating service 2 cleanup
Sep 18 00:43:20 devstack cinder-volume[76559]: INFO cinder.manager [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Service 2 cleanup completed.
Sep 18 00:43:20 devstack cinder-volume[76559]: DEBUG cinder.service [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Creating RPC server for service cinder-volume {{(pid=76559) start /opt/stack/cinder/cinder/service.py:239}}
Sep 18 00:43:20 devstack cinder-volume[76559]: DEBUG cinder.service [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76559) start /opt/stack/cinder/cinder/service.py:245}}
Sep 18 00:43:20 devstack cinder-volume[76559]: INFO cinder.volume.manager [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 18 00:43:20 devstack cinder-volume[76559]: DEBUG cinder.volume.drivers.lvm [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Updating volume stats {{(pid=76559) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 00:43:20 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:43:20 devstack sudo[77721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 00:43:20 devstack sudo[77721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:43:22 devstack sudo[77721]: pam_unix(sudo:session): session closed for user root
Sep 18 00:43:22 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.994s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:22 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:43:22 devstack sudo[77729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:43:22 devstack sudo[77729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:43:24 devstack sudo[77729]: pam_unix(sudo:session): session closed for user root
Sep 18 00:43:24 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.406s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:24 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:43:25 devstack sudo[77737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 00:43:25 devstack sudo[77737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:43:26 devstack sudo[77737]: pam_unix(sudo:session): session closed for user root
Sep 18 00:43:27 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.077s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:27 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:43:27 devstack sudo[77741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:43:27 devstack sudo[77741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:43:28 devstack sudo[77741]: pam_unix(sudo:session): session closed for user root
Sep 18 00:43:28 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.741s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:43:28 devstack cinder-volume[76559]: INFO cinder.volume.manager [None req-b504611d-62f6-4ec4-8985-4da33e503af2 None None] Driver post RPC initialization completed successfully.
Sep 18 00:43:38 devstack cinder-volume[76559]: DEBUG dbcounter [-] [76559] Writing DB stats cinder:SELECT=4 {{(pid=76559) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:43:38 devstack cinder-volume[76559]: DEBUG dbcounter [-] [76559] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76559) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:44:25 devstack cinder-volume[76559]: DEBUG oslo_service.periodic_task [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76559) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:44:25 devstack cinder-volume[76559]: DEBUG cinder.volume.drivers.lvm [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Updating volume stats {{(pid=76559) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 00:44:25 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:44:26 devstack sudo[79091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 00:44:26 devstack sudo[79091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:44:28 devstack sudo[79091]: pam_unix(sudo:session): session closed for user root
Sep 18 00:44:28 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.019s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:44:28 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:44:28 devstack sudo[79104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:44:28 devstack sudo[79104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:44:29 devstack sudo[79104]: pam_unix(sudo:session): session closed for user root
Sep 18 00:44:29 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.823s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:44:29 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:44:29 devstack sudo[79107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 00:44:29 devstack sudo[79107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:44:31 devstack sudo[79107]: pam_unix(sudo:session): session closed for user root
Sep 18 00:44:31 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.923s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:44:31 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:44:31 devstack sudo[79112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:44:31 devstack sudo[79112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:44:33 devstack sudo[79112]: pam_unix(sudo:session): session closed for user root
Sep 18 00:44:33 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.931s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:44:33 devstack cinder-volume[76559]: DEBUG cinder.manager [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Notifying Schedulers of capabilities ... {{(pid=76559) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:45:25 devstack cinder-volume[76559]: DEBUG oslo_service.periodic_task [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76559) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:45:25 devstack cinder-volume[76559]: DEBUG cinder.volume.drivers.lvm [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Updating volume stats {{(pid=76559) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 00:45:25 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:45:26 devstack sudo[79739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 00:45:26 devstack sudo[79739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:45:27 devstack sudo[79739]: pam_unix(sudo:session): session closed for user root
Sep 18 00:45:27 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.973s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:45:27 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:45:28 devstack sudo[79834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:45:28 devstack sudo[79834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:45:29 devstack sudo[79834]: pam_unix(sudo:session): session closed for user root
Sep 18 00:45:29 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.963s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:45:29 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:45:30 devstack sudo[79844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 00:45:30 devstack sudo[79844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:45:31 devstack sudo[79844]: pam_unix(sudo:session): session closed for user root
Sep 18 00:45:31 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.946s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:45:31 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:45:32 devstack sudo[79848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:45:32 devstack sudo[79848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:45:33 devstack sudo[79848]: pam_unix(sudo:session): session closed for user root
Sep 18 00:45:33 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.891s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:45:33 devstack cinder-volume[76559]: DEBUG cinder.manager [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Notifying Schedulers of capabilities ... {{(pid=76559) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:45:39 devstack cinder-volume[76559]: DEBUG dbcounter [-] [76559] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76559) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:46:25 devstack cinder-volume[76559]: DEBUG oslo_service.periodic_task [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76559) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:46:25 devstack cinder-volume[76559]: DEBUG cinder.volume.drivers.lvm [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Updating volume stats {{(pid=76559) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 00:46:26 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:46:26 devstack sudo[82626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 00:46:26 devstack sudo[82626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:46:27 devstack sudo[82626]: pam_unix(sudo:session): session closed for user root
Sep 18 00:46:27 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.897s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:46:27 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:46:28 devstack sudo[82630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:46:28 devstack sudo[82630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:46:29 devstack sudo[82630]: pam_unix(sudo:session): session closed for user root
Sep 18 00:46:29 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.782s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:46:29 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:46:29 devstack sudo[82633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 00:46:29 devstack sudo[82633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:46:31 devstack sudo[82633]: pam_unix(sudo:session): session closed for user root
Sep 18 00:46:31 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.781s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:46:31 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:46:31 devstack sudo[82636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:46:31 devstack sudo[82636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:46:33 devstack sudo[82636]: pam_unix(sudo:session): session closed for user root
Sep 18 00:46:33 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.804s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:46:33 devstack cinder-volume[76559]: DEBUG cinder.manager [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Notifying Schedulers of capabilities ... {{(pid=76559) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:47:25 devstack cinder-volume[76559]: DEBUG oslo_service.periodic_task [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76559) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:47:25 devstack cinder-volume[76559]: DEBUG cinder.volume.drivers.lvm [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Updating volume stats {{(pid=76559) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 00:47:26 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:47:26 devstack sudo[82929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 00:47:26 devstack sudo[82929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:47:27 devstack sudo[82929]: pam_unix(sudo:session): session closed for user root
Sep 18 00:47:27 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.788s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:47:27 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:47:27 devstack sudo[82936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:47:27 devstack sudo[82936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:47:29 devstack sudo[82936]: pam_unix(sudo:session): session closed for user root
Sep 18 00:47:29 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.899s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:47:29 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:47:29 devstack sudo[82939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 00:47:29 devstack sudo[82939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:47:31 devstack sudo[82939]: pam_unix(sudo:session): session closed for user root
Sep 18 00:47:31 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.840s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:47:31 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:47:31 devstack sudo[82942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:47:31 devstack sudo[82942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:47:33 devstack sudo[82942]: pam_unix(sudo:session): session closed for user root
Sep 18 00:47:33 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.760s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:47:33 devstack cinder-volume[76559]: DEBUG cinder.manager [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Notifying Schedulers of capabilities ... {{(pid=76559) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:47:39 devstack cinder-volume[76559]: DEBUG dbcounter [-] [76559] Writing DB stats cinder:SELECT=1 {{(pid=76559) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:47:39 devstack cinder-volume[76559]: DEBUG dbcounter [-] [76559] Writing DB stats cinder:UPDATE=1 {{(pid=76559) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:48:25 devstack cinder-volume[76559]: DEBUG oslo_service.periodic_task [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76559) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:48:26 devstack cinder-volume[76559]: DEBUG cinder.volume.drivers.lvm [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Updating volume stats {{(pid=76559) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 00:48:26 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:48:26 devstack sudo[83382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 00:48:26 devstack sudo[83382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:48:28 devstack sudo[83382]: pam_unix(sudo:session): session closed for user root
Sep 18 00:48:28 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.695s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:48:28 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:48:28 devstack sudo[83529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:48:28 devstack sudo[83529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:48:31 devstack sudo[83529]: pam_unix(sudo:session): session closed for user root
Sep 18 00:48:31 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.469s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:48:31 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:48:31 devstack sudo[83612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 00:48:31 devstack sudo[83612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:48:33 devstack sudo[83612]: pam_unix(sudo:session): session closed for user root
Sep 18 00:48:33 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.637s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:48:33 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:48:34 devstack sudo[83642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 00:48:34 devstack sudo[83642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:48:36 devstack sudo[83642]: pam_unix(sudo:session): session closed for user root
Sep 18 00:48:36 devstack cinder-volume[76559]: DEBUG oslo_concurrency.processutils [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.859s {{(pid=76559) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:48:36 devstack cinder-volume[76559]: DEBUG cinder.manager [None req-3f543c77-6087-4a6b-816e-782edd7ddcbb None None] Notifying Schedulers of capabilities ... {{(pid=76559) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:48:48 devstack cinder-volume[76407]: INFO oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Caught SIGTERM, stopping children
Sep 18 00:48:48 devstack cinder-volume[76407]: DEBUG oslo_concurrency.lockutils [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Acquiring lock "singleton_lock" {{(pid=76407) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 00:48:48 devstack cinder-volume[76407]: DEBUG oslo_concurrency.lockutils [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Acquired lock "singleton_lock" {{(pid=76407) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 00:48:48 devstack cinder-volume[76407]: DEBUG oslo_concurrency.lockutils [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Releasing lock "singleton_lock" {{(pid=76407) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 00:48:48 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Stop services. {{(pid=76407) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 18 00:48:48 devstack cinder-volume[76407]: DEBUG oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Killing children. {{(pid=76407) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 18 00:48:48 devstack cinder-volume[76407]: INFO oslo_service.backend._eventlet.service [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Waiting on 1 children to exit
Sep 18 00:48:53 devstack cinder-volume[76559]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Sep 18 00:48:55 devstack cinder-volume[76559]: DEBUG oslo_concurrency.lockutils [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Acquiring lock "singleton_lock" {{(pid=76559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 00:48:55 devstack cinder-volume[76559]: DEBUG oslo_concurrency.lockutils [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Acquired lock "singleton_lock" {{(pid=76559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 00:48:55 devstack cinder-volume[76559]: DEBUG oslo_concurrency.lockutils [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Releasing lock "singleton_lock" {{(pid=76559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 00:48:55 devstack cinder-volume[76559]: WARNING amqp [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 18 00:48:55 devstack cinder-volume[76559]: WARNING amqp [None req-914c5938-fdc3-49a3-a096-4277c39ef146 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 18 00:49:09 devstack cinder-volume[83928]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 00:49:09 devstack cinder-volume[83928]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 00:49:09 devstack cinder-volume[83928]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 00:49:11 devstack cinder-volume[83928]: INFO dbcounter [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] Registered counter for database cinder
Sep 18 00:49:11 devstack cinder-volume[83928]: DEBUG oslo_db.sqlalchemy.engines [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83928) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG dbcounter [-] [83928] Writer thread running {{(pid=83928) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 00:49:12 devstack cinder-volume[83928]: INFO cinder.rpc [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 18 00:49:12 devstack cinder-volume[83928]: INFO cinder.rpc [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_db.sqlalchemy.engines [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83928) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 00:49:12 devstack cinder-volume[83928]: INFO cinder.volume.manager [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] Determined volume DB was empty at startup.
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG cinder.volume.manager [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83928) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 18 00:49:12 devstack cinder-volume[83928]: INFO cinder.volume.manager [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 18 00:49:12 devstack cinder-volume[83928]: WARNING stevedore.named [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 18 00:49:12 devstack cinder-volume[83928]: WARNING castellan.key_manager [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 00:49:12 devstack cinder-volume[83928]: WARNING cinder.keymgr.conf_key_mgr [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 00:49:12 devstack cinder-volume[83928]: INFO cinder.volume.manager [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_db.sqlalchemy.engines [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83928) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 00:49:12 devstack cinder-volume[83928]: INFO oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] Starting 1 workers
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] Started child 84134 {{(pid=83928) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] Full set of CONF: {{(pid=83928) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] ******************************************************************************** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] Configuration options gathered from: {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] ================================================================================ {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] allow_availability_zone_fallback = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] allow_compression_on_image_upload = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] allowed_direct_url_schemes     = [] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] api_rate_limit                 = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] auth_strategy                  = keystone {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_availability_zone      = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_host                   = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_name                   = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_stats_polling_interval = 60 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backup_api_class               = cinder.backup.api.API {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backup_name_template           = backup-%s {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backup_use_same_host           = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backup_use_temp_snapshot       = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] chap_password                  = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] chap_username                  =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cinder_internal_tenant_project_id = d9a57c51f7f147ef83704d9bfee7ce84 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cinder_internal_tenant_user_id = 69ac5d70d4f548119b5846f142d26bff {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cluster                        = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[84134]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] compression_format             = gzip {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] compute_api_class              = cinder.compute.nova.API {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] config_dir                     = [] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] config_source                  = [] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] control_exchange               = openstack {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] debug                          = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] default_availability_zone      = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] default_group_type             = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] default_volume_type            = QuobyteHD {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] driver_client_cert             = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] driver_client_cert_key         = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] driver_data_namespace          = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] driver_ssl_cert_path           = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] driver_ssl_cert_verify         = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] driver_use_ssl                 = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] enable_new_services            = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] enable_unsupported_driver      = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] enabled_backends               = ['QuobyteHD'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] enforce_multipath_for_image_xfer = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] filter_function                = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance_api_insecure            = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance_api_servers             = ['http://192.168.122.180/image'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance_api_ssl_compression     = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance_ca_certificates_file    = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance_catalog_info            = image:glance:publicURL {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance_certfile                = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance_keyfile                 = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance_num_retries             = 3 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance_request_timeout         = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] goodness_function              = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] graceful_shutdown_timeout      = 5 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] group_api_class                = cinder.group.api.API {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] host                           = devstack {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] image_compress_on_upload       = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] image_conversion_address_space_limit = 1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] image_conversion_cpu_limit     = 60 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] image_conversion_disable       = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] image_upload_use_cinder_backend = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] image_upload_use_internal_tenant = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] image_volume_cache_enabled     = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] image_volume_cache_max_count   = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] image_volume_cache_max_size_gb = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] init_host_max_objects_retrieval = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] instance_format                = [instance: %(uuid)s]  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] iscsi_iotype                   = fileio {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] iscsi_target_flags             =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] iscsi_write_cache              = on {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] iser_helper                    = tgtadm {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] iser_ip_address                = 192.168.122.180 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] iser_port                      = 3260 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] log_color                      = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] log_config_append              = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] log_dir                        = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] log_file                       = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] log_options                    = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] log_rotate_interval            = 1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] log_rotate_interval_type       = days {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] log_rotation_type              = none {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] max_age                        = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] max_logfile_count              = 30 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] max_logfile_size_mb            = 200 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] max_over_subscription_ratio    = 20.0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] message_reap_interval          = 86400 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] message_ttl                    = 2592000 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] migration_create_volume_timeout_secs = 300 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] monkey_patch                   = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] monkey_patch_modules           = [] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] my_ip                          = 192.168.122.180 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] no_snapshot_gb_quota           = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] num_iser_scan_tries            = 3 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] num_shell_tries                = 3 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] num_volume_device_scan_tries   = 3 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] nvmeof_conn_info_version       = 1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] nvmet_ns_id                    = 10 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] nvmet_port_id                  = 1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] osapi_max_limit                = 1000 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] osapi_volume_ext_list          = [] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] osapi_volume_listen_port       = 8776 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] osapi_volume_use_ssl           = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] osapi_volume_workers           = 2 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] per_volume_size_limit          = -1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] periodic_fuzzy_delay           = 60 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] periodic_interval              = 60 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] public_endpoint                = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] publish_errors                 = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] quota_backup_gigabytes         = 1000 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] quota_backups                  = 10 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] quota_gigabytes                = 1000 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] quota_groups                   = 10 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] quota_snapshots                = 10 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] quota_volumes                  = 10 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] rate_limit_burst               = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] rate_limit_except_level        = CRITICAL {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] rate_limit_interval            = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] reinit_driver_count            = 3 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] replication_device             = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] report_discard_supported       = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] report_interval                = 120 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] reservation_clean_interval     = 86400 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] reservation_expire             = 86400 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] reserved_image_namespaces      = [] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] reserved_percentage            = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] rpc_response_timeout           = 120 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] run_external_periodic_tasks    = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] scst_target_driver             = iscsi {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] scst_target_iqn_name           = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] service_down_time              = 720 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] shell_completion               = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] snapshot_name_template         = snapshot-%s {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] split_loggers                  = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] state_path                     = /opt/stack/data/cinder {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] storage_availability_zone      = nova {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] storage_protocol               = iSCSI {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] syslog_log_facility            = LOG_USER {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] target_helper                  = lioadm {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] target_ip_address              = 192.168.122.180 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] target_port                    = 3260 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] target_protocol                = iscsi {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] target_secondary_ip_addresses  = [] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] trace_flags                    = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] transport_url                  = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] until_refresh                  = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] use_chap_auth                  = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] use_default_quota_class        = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] use_journal                    = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] use_json                       = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] use_multipath_for_image_xfer   = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] use_stderr                     = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] use_syslog                     = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] verify_glance_signatures       = enabled {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] volume_api_class               = cinder.volume.api.API {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] volume_backend_name            = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] volume_clear                   = zero {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] volume_clear_ionice            = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] volume_clear_size              = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] volume_copy_bps_limit          = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] volume_dd_blocksize            = 1M {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] volume_name_template           = volume-%s {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] volume_service_inithost_offload = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] volume_usage_audit_period      = month {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] watch_log_file                 = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] zoning_mode                    = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_concurrency.disable_process_locking = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.admin_password = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.admin_token = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.admin_user  = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.auth_port   = 35357 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.auth_protocol = https {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.auth_section = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.auth_type   = password {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.auth_uri    = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.auth_version = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.cache       = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.certfile    = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.identity_uri = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=84134) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.include_service_catalog = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.insecure    = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.interface   = public {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.keyfile     = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_password =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcache_username =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.region_name = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.service_type = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.backend                  = dogpile.cache.null {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.backend_argument         = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.backend_expiration_time  = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.config_prefix            = cache.oslo {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.dead_timeout             = 60.0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.debug_cache_backend      = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.enable_retry_client      = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.enable_socket_keepalive  = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.enabled                  = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.enforce_fips_mode        = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.expiration_time          = 600 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.hashclient_retry_attempts = 2 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.memcache_dead_retry      = 300 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.memcache_password        = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.memcache_pool_maxsize    = 10 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.memcache_sasl_enabled    = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.memcache_username        = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.proxies                  = [] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.redis_db                 = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.redis_password           = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.redis_server             = localhost:6379 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.redis_socket_timeout     = 1.0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.redis_username           = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.retry_attempts           = 2 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.retry_delay              = 0.0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.socket_keepalive_count   = 1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.socket_keepalive_idle    = 1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.socket_keepalive_interval = 1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.tls_allowed_ciphers      = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.tls_cafile               = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.tls_certfile             = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.tls_enabled              = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cache.tls_keyfile              = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] coordination.backend_url       = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.asyncio_connection    = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.asyncio_slave_connection = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.backend               = sqlalchemy {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.connection            = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.connection_debug      = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.connection_parameters =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.connection_recycle_time = 3600 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.connection_trace      = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.db_inc_retry_interval = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.db_max_retries        = 20 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.db_max_retry_interval = 10 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.db_retry_interval     = 1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.max_overflow          = 50 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.max_pool_size         = 5 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.max_retries           = 10 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.mysql_wsrep_sync_wait = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.pool_timeout          = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.retry_interval        = 10 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.slave_connection      = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.sqlite_synchronous    = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] database.use_db_reconnect      = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] profiler.connection_string     = messaging:// {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] profiler.enabled               = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] profiler.es_doc_type           = notification {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] profiler.es_scroll_size        = 10000 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] profiler.es_scroll_time        = 2m {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] profiler.filter_error_trace    = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] profiler.hmac_keys             = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] profiler.sentinel_service_name = mymaster {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] profiler.socket_timeout        = 0.1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] profiler.trace_requests        = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] profiler.trace_sqlalchemy      = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] profiler_jaeger.process_tags   = {} {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] profiler_jaeger.service_name_prefix = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] profiler_otlp.service_name_prefix = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_policy.enforce_new_defaults = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: WARNING oslo_config.cfg [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_policy.enforce_scope      = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_policy.policy_default_rule = default {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_policy.policy_file        = policy.yaml {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] privsep_osbrick.group          = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] privsep_osbrick.helper_command = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] privsep_osbrick.user           = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cinder_sys_admin.group         = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cinder_sys_admin.helper_command = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] cinder_sys_admin.user          = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] service_user.auth_section      = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] service_user.auth_type         = password {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] service_user.certfile          = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] service_user.collect_timing    = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] service_user.insecure          = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] service_user.keyfile           = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] service_user.send_service_user_token = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] service_user.split_loggers     = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] service_user.timeout           = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance.auth_section            = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance.auth_type               = password {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance.certfile                = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance.collect_timing          = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance.insecure                = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance.keyfile                 = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance.split_loggers           = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] glance.timeout                 = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.backend_availability_zone = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.chap_password = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.chap_username =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.driver_client_cert = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.driver_client_cert_key = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.driver_data_namespace = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.driver_use_ssl = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.extra_capabilities = {} {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.filter_function = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.goodness_function = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.iscsi_target_flags =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.iscsi_write_cache = on {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.iser_helper   = tgtadm {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.iser_ip_address = 192.168.122.180 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.iser_port     = 3260 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.nas_host      =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.nas_login     = admin {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.nas_mount_options = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.nas_password  = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.nas_private_key =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.nas_share_path =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.num_shell_tries = 3 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.quobyte_volume_url = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.replication_device = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.report_discard_supported = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.reserved_percentage = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.target_helper = tgtadm {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.target_ip_address = 192.168.122.180 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.target_port   = 3260 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=84134) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 18 00:49:12 devstack cinder-volume[84134]: INFO cinder.volume.drivers.quobyte [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.target_protocol = iscsi {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.trace_flags   = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.unique_fqdn_network = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.use_chap_auth = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Running cmd (subprocess): mount.quobyte {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.volume_backend_name = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.volume_clear  = zero {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.volume_clear_ionice = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.volume_clear_size = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_reports.file_event_handler = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_reports.log_dir           = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.backend_availability_zone = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.backend_host         = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.chap_password        = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.chap_username        = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.chiscsi_conf         = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.driver_client_cert   = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.driver_data_namespace = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.driver_use_ssl       = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.extra_capabilities   = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.filter_function      = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.goodness_function    = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.iscsi_iotype         = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.iser_helper          = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.iser_ip_address      = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.iser_port            = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.iser_target_prefix   = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.nas_host             = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.nas_login            = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.nas_mount_options    = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.nas_password         = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.nas_private_key      = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.nas_share_path       = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.nas_ssh_port         = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.num_shell_tries      = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.nvmet_port_id        = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.replication_device   = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.report_discard_supported = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.reserved_percentage  = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.scst_target_driver   = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.storage_protocol     = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.target_helper        = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.target_ip_address    = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.target_port          = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.target_prefix        = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.target_protocol      = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.trace_flags          = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.use_chap_auth        = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.volume_clear         = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.volume_clear_size    = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] QuobyteHD.volumes_dir          = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.ssl      = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_notifications.driver = [] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_notifications.retry = -1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] key_manager.fixed_key          = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.barbican_api_version  = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.barbican_endpoint     = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.barbican_endpoint_type = public {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.barbican_region_name  = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.cafile                = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.certfile              = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.collect_timing        = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.insecure              = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.keyfile               = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.number_of_retries     = 60 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.retry_delay           = 1 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.send_service_user_token = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.split_loggers         = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.timeout               = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.verify_ssl            = True {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican.verify_ssl_path       = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican_service_user.auth_section = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican_service_user.auth_type = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican_service_user.cafile   = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican_service_user.certfile = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican_service_user.collect_timing = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican_service_user.insecure = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican_service_user.keyfile  = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican_service_user.split_loggers = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] barbican_service_user.timeout  = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] vault.approle_role_id          = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] vault.approle_secret_id        = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] vault.kv_mountpoint            = secret {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] vault.kv_path                  = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] vault.kv_version               = 2 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] vault.namespace                = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] vault.root_token_id            = **** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] vault.ssl_ca_crt_file          = None {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] vault.timeout                  = 60.0 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] vault.use_ssl                  = False {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 00:49:12 devstack cinder-volume[83928]: DEBUG oslo_service.backend._eventlet.service [None req-de45a324-9582-40fd-8354-0e6e229b5b29 None None] ******************************************************************************** {{(pid=83928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 18 00:49:13 devstack quobyte-client[84135]: Reading configuration file: /etc/quobyte/client.cfg
Sep 18 00:49:13 devstack quobyte-client[84135]: Invalid parameters found, error: missing mount point.
Sep 18 00:49:13 devstack quobyte-client[84135]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 18 00:49:13 devstack quobyte-client[84135]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 18 00:49:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] CMD "mount.quobyte" returned: 1 in 0.282s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:49:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:49:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:49:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:49:13 devstack cinder-volume[84134]: INFO cinder.volume.drivers.quobyte [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Mounting volume: 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 ...
Sep 18 00:49:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 -c /etc/quobyte/client-cinder.cfg {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:49:13 devstack quobyte-client[84146]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 18 00:49:13 devstack quobyte-client[84146]: Reading configuration file: /etc/quobyte/client.cfg
Sep 18 00:49:13 devstack quobyte-client[84146]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046' to display the log.
Sep 18 00:49:13 devstack quobyte-client[84147]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 18 00:49:13 devstack quobyte-client[84147]: mount.quobyte 3.25 (4fbbd59204)
Sep 18 00:49:13 devstack quobyte-client[84147]: Client UUID: upO4av8r-nAqS-QAuf-TyCb-JaXexDlJLjPx
Sep 18 00:49:13 devstack quobyte-client[84147]: Registry: osci01.corp.quobyte.com:7861
Sep 18 00:49:13 devstack quobyte-client[84147]: Volume: cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 00:49:13 devstack quobyte-client[84147]: FUSE version: 316
Sep 18 00:49:13 devstack quobyte-client[84147]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 18 00:49:13 devstack quobyte-client[84147]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 18 00:49:13 devstack quobyte-client[84147]: Setting total object cache size to 3352297472 bytes
Sep 18 00:49:13 devstack quobyte-client[84147]: Using FUSE low-level API
Sep 18 00:49:13 devstack quobyte-client[84147]: Caching of uid/gid to user/group name mappings is enabled
Sep 18 00:49:13 devstack quobyte-client[84147]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 18 00:49:13 devstack quobyte-client[84147]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 18 00:49:13 devstack quobyte-client[84147]: HTTP server started on port 55000
Sep 18 00:49:13 devstack quobyte-client[84147]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 18 00:49:13 devstack quobyte-client[84147]: Mount point /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 established
Sep 18 00:49:13 devstack quobyte-client[84147]: TimeSync is running and remote sync every 60 seconds
Sep 18 00:49:13 devstack quobyte-client[84147]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 00:49:13 devstack quobyte-client[84147]: Ignored time synchronization message because time source took too long to respond (59 ms)
Sep 18 00:49:13 devstack quobyte-client[84147]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 00:49:13 devstack quobyte-client[84147]: Opening volume cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 (4b65a7e5-5fec-405f-a51f-611d8e832cfc)
Sep 18 00:49:13 devstack quobyte-client[84147]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 18 00:49:13 devstack quobyte-client[84147]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 00:49:13 devstack quobyte-client[84147]: Failed to invalidate inode: 38: Function not implemented
Sep 18 00:49:13 devstack quobyte-client[84147]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 00:49:13 devstack quobyte-client[84147]: Automatic minidump upload enabled by global system configuration
Sep 18 00:49:13 devstack quobyte-client[84147]: Announcing HTTP status server address 172.24.4.1
Sep 18 00:49:13 devstack quobyte-client[84147]: Registered as service (uuid upO4av8r-nAqS-QAuf-TyCb-JaXexDlJLjPx)
Sep 18 00:49:13 devstack quobyte-client[84147]: Quobyte Client running as pid 84147
Sep 18 00:49:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.603s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:49:13 devstack quobyte-client[84147]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 18 00:49:13 devstack quobyte-client[84147]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 18 00:49:13 devstack cinder-volume[84134]: INFO cinder.volume.drivers.quobyte [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Mounting volume: 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 succeeded
Sep 18 00:49:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:49:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.667s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:49:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:49:13 devstack quobyte-client[84147]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 00:49:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.114s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:49:13 devstack cinder-volume[84134]: INFO cinder.volume.driver [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Driver hasn't implemented _init_vendor_properties()
Sep 18 00:49:13 devstack cinder-volume[84134]: DEBUG cinder.volume.driver [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84134) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG oslo_db.sqlalchemy.engines [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84134) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writer thread running {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG cinder.db.sqlalchemy.api [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Building query based on filter {{(pid=84134) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84134) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 18 00:49:14 devstack cinder-volume[84134]: INFO cinder.keymgr.migration [None req-94ed388a-7b19-46b0-92b4-c271189cc17a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.067s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:49:14 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Driver initialization completed successfully.
Sep 18 00:49:14 devstack cinder-volume[84134]: INFO cinder.manager [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Initiating service 3 cleanup
Sep 18 00:49:14 devstack cinder-volume[84134]: INFO cinder.manager [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Service 3 cleanup completed.
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG cinder.service [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Creating RPC server for service cinder-volume {{(pid=84134) start /opt/stack/cinder/cinder/service.py:239}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG cinder.service [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84134) start /opt/stack/cinder/cinder/service.py:245}}
Sep 18 00:49:14 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 18 00:49:14 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:49:14 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:49:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:49:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.100s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:49:15 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e9971221-4e9f-494c-b8b1-a67f7cd15ac1 None None] Driver post RPC initialization completed successfully.
Sep 18 00:49:16 devstack quobyte-client[84147]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 00:49:22 devstack cinder-volume[83928]: DEBUG dbcounter [-] [83928] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83928) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:49:25 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:49:25 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:50:12 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:50:12 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 00:50:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Flow 'volume_create_manager' (a84484c4-dff0-4263-a8d7-194e0e036eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:50:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72775c79-e5a5-46ea-9d94-2ec46a93f0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72775c79-e5a5-46ea-9d94-2ec46a93f0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1389466220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44e6a86-824d-4bcc-a6db-5f085758f0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e30a224950a4c9d98593f8d837ac027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:50:12Z,use_quota=True,user_id='f95ca26592674f9ab2f51c67af38d8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1854c922-185c-414a-a75d-815d18318c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1854c922-185c-414a-a75d-815d18318c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8580a933-901d-4d89-bee0-c4a4b683914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:12 devstack cinder-volume[84134]: DEBUG cinder.image.glance [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Creating Keystone auth plugin from conf {{(pid=84134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 00:50:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8580a933-901d-4d89-bee0-c4a4b683914a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a44e6a86-824d-4bcc-a6db-5f085758f0d8', 'volume_name': 'volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8', 'volume_size': 1, 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4803f5aa86a5490f958758e19b57c0e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07cf3200-362f-436f-805e-70da90459e61', 'created_at': datetime.datetime(2025, 9, 17, 22, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 22, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07cf3200-362f-436f-805e-70da90459e61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4b12780a0>}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d057746-2fe7-4e65-ab4e-f17534d512fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d057746-2fe7-4e65-ab4e-f17534d512fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78827f3d-2d70-4d71-815d-14b97abd16d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:13 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Volume a44e6a86-824d-4bcc-a6db-5f085758f0d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8', 'volume_size': 1, 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4803f5aa86a5490f958758e19b57c0e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07cf3200-362f-436f-805e-70da90459e61', 'created_at': datetime.datetime(2025, 9, 17, 22, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 22, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07cf3200-362f-436f-805e-70da90459e61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4b12780a0>}
Sep 18 00:50:13 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Cloning a44e6a86-824d-4bcc-a6db-5f085758f0d8 from image 07cf3200-362f-436f-805e-70da90459e61  at location (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]). {{(pid=84134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 00:50:13 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_3f1iq8_2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 00:50:13 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 00:50:13 devstack cinder-volume[84134]: INFO oslo.privsep.daemon [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfgzoe10d/privsep.sock']
Sep 18 00:50:13 devstack sudo[84447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfgzoe10d/privsep.sock
Sep 18 00:50:13 devstack sudo[84447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:50:19 devstack sudo[84447]: pam_unix(sudo:session): session closed for user root
Sep 18 00:50:19 devstack cinder-volume[84134]: INFO oslo.privsep.daemon [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Spawned new privsep daemon via rootwrap
Sep 18 00:50:19 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Accepted privsep connection to /tmp/tmpfgzoe10d/privsep.sock {{(pid=84134) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 18 00:50:19 devstack cinder-volume[84134]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 18 00:50:19 devstack cinder-volume[84134]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 18 00:50:19 devstack cinder-volume[84134]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 18 00:50:19 devstack cinder-volume[84134]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84457
Sep 18 00:50:19 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b80062-226e-44cb-a801-a1771d61d7f4]: (2,) {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:50:19 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a8f23d-3467-4b6b-8e3d-b343dc0fce9a]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:50:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_3f1iq8_2devstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:19 devstack sudo[84460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_3f1iq8_2devstack@QuobyteHD
Sep 18 00:50:19 devstack sudo[84460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:50:22 devstack sudo[84460]: pam_unix(sudo:session): session closed for user root
Sep 18 00:50:22 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:50:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_3f1iq8_2devstack@QuobyteHD" returned: 0 in 3.304s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:22 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Temporary image 07cf3200-362f-436f-805e-70da90459e61 is fetched for user f95ca26592674f9ab2f51c67af38d8cb. {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 00:50:22 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:50:23 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[302cad9c-f85b-4362-853b-3d75bf32d158]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:50:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_3f1iq8_2devstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:23 devstack sudo[84473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_3f1iq8_2devstack@QuobyteHD
Sep 18 00:50:23 devstack sudo[84473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 00:50:26 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:50:26 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 00:50:26 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Flow 'volume_create_manager' (b8e4f396-e039-4735-9d85-540b3534bad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:50:26 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a203b4b-ec75-46ab-bd90-d30a69f4a928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a203b4b-ec75-46ab-bd90-d30a69f4a928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-361770692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b220abd-ff02-478a-b04f-26a0d4bcbf5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a717e047ddd545949f20a24abdfe18f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:50:26Z,use_quota=True,user_id='fb526f5ee0ea43c88203e0ea482f2f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae1faba-2111-42cc-90e2-864d1278aec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae1faba-2111-42cc-90e2-864d1278aec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2458a2f1-b6ca-438a-bb8d-404a6ca5593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2458a2f1-b6ca-438a-bb8d-404a6ca5593e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b220abd-ff02-478a-b04f-26a0d4bcbf5d', 'volume_name': 'volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1acd25b8-7d8c-40df-9709-4b65521491dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1acd25b8-7d8c-40df-9709-4b65521491dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a94aac05-03a4-477c-aeff-c8e5f2d0a563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:27 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Volume 4b220abd-ff02-478a-b04f-26a0d4bcbf5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d', 'volume_size': 1}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-361770692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b220abd-ff02-478a-b04f-26a0d4bcbf5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a717e047ddd545949f20a24abdfe18f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:50:26Z,use_quota=True,user_id='fb526f5ee0ea43c88203e0ea482f2f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Creating volume 4b220abd-ff02-478a-b04f-26a0d4bcbf5d {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 00:50:27 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 00:50:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:27 devstack quobyte-client[84147]: System call of process 84524 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:50:28 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=2, name=volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 00:50:28 devstack sudo[84473]: pam_unix(sudo:session): session closed for user root
Sep 18 00:50:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_3f1iq8_2devstack@QuobyteHD" returned: 0 in 5.029s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:50:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d 1073741824" returned: 0 in 1.053s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d" returned: 0 in 0.157s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] <== create_volume: return (1294ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 00:50:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:50:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.715s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:50:29 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1389466220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44e6a86-824d-4bcc-a6db-5f085758f0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e30a224950a4c9d98593f8d837ac027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:50:12Z,use_quota=True,user_id='f95ca26592674f9ab2f51c67af38d8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 00:50:29 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Creating volume a44e6a86-824d-4bcc-a6db-5f085758f0d8 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 00:50:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:50:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:50:29 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:50:29 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:50:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:50:29 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 00:50:29 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 00:50:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:29 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=3, name=volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 00:50:29 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a94aac05-03a4-477c-aeff-c8e5f2d0a563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:29 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c883475-ef68-402a-b3a9-94b32e5bb759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 1073741824" returned: 0 in 0.571s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:29 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Volume volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d (4b220abd-ff02-478a-b04f-26a0d4bcbf5d): created successfully
Sep 18 00:50:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c883475-ef68-402a-b3a9-94b32e5bb759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Flow 'volume_create_manager' (b8e4f396-e039-4735-9d85-540b3534bad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:50:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8" returned: 0 in 0.450s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] <== create_volume: return (1075ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 00:50:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:50:30 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-7a18bdd7-bc2a-4ad7-8f9a-2998fc72fb7d tempest-VolumesAssistedSnapshotsTest-1953327583 None] Created volume successfully.
Sep 18 00:50:30 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Attempting download of 07cf3200-362f-436f-805e-70da90459e61 ((None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}])) to volume a44e6a86-824d-4bcc-a6db-5f085758f0d8. {{(pid=84134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 00:50:30 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b80f02c-2e25-44e0-97ec-d8504fa8c73f]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:50:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_oq8qqahc {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_oq8qqahc" returned: 0 in 0.489s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_oq8qqahc {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_oq8qqahc" returned: 1 in 0.898s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_oq8qqahc' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 00:50:32 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[26101a97-573c-4395-bf37-833dcbe614bc]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:50:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_3f1iq8_2devstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_3f1iq8_2devstack@QuobyteHD" returned: 0 in 0.689s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:32 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] 07cf3200-362f-436f-805e-70da90459e61 was qcow2, converting to raw {{(pid=84134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 00:50:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_3f1iq8_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:33 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=3, name=volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 00:50:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_3f1iq8_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8" returned: 0 in 1.307s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:34 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_3f1iq8_2devstack@QuobyteHD, size 112.00 MB, duration 1.34 sec, destination /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 {{(pid=84134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 00:50:34 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Converted 112.00 MB image at 83.49 MB/s
Sep 18 00:50:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 1G" returned: 0 in 0.200s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:34 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c08e049-3139-43bd-aa56-aedb9323f2d9]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:50:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8" returned: 0 in 0.560s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8" returned: 1 in 0.562s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 00:50:35 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Downloaded image 07cf3200-362f-436f-805e-70da90459e61 ((None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}])) to volume a44e6a86-824d-4bcc-a6db-5f085758f0d8 successfully. {{(pid=84134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 00:50:35 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Temporary image 07cf3200-362f-436f-805e-70da90459e61 for user f95ca26592674f9ab2f51c67af38d8cb is deleted. {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 00:50:35 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Marking volume a44e6a86-824d-4bcc-a6db-5f085758f0d8 as bootable. {{(pid=84134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 00:50:36 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Copying metadata from image 07cf3200-362f-436f-805e-70da90459e61 to a44e6a86-824d-4bcc-a6db-5f085758f0d8. {{(pid=84134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 00:50:36 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Creating volume glance metadata for volume a44e6a86-824d-4bcc-a6db-5f085758f0d8 backed by image 07cf3200-362f-436f-805e-70da90459e61 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 00:50:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78827f3d-2d70-4d71-815d-14b97abd16d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8', 'volume_size': 1, 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4803f5aa86a5490f958758e19b57c0e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07cf3200-362f-436f-805e-70da90459e61', 'created_at': datetime.datetime(2025, 9, 17, 22, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 22, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07cf3200-362f-436f-805e-70da90459e61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4b12780a0>}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280954e8-bd24-4eaf-a86d-e122b2cbcc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:36 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Volume volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 (a44e6a86-824d-4bcc-a6db-5f085758f0d8): created successfully
Sep 18 00:50:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280954e8-bd24-4eaf-a86d-e122b2cbcc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Flow 'volume_create_manager' (a84484c4-dff0-4263-a8d7-194e0e036eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:50:36 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8aeb5164-5384-430d-bfd3-a50e23a5f129 tempest-TaggedBootDevicesTest-587649175 None] Created volume successfully.
Sep 18 00:50:38 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Flow 'volume_create_manager' (752eb2cc-02c4-46b5-a554-9bc4c6150dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893061d8-1fed-498b-a657-67364815401b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893061d8-1fed-498b-a657-67364815401b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1650170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90d157e-be86-422e-80fa-95bf9fdbf47a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e30a224950a4c9d98593f8d837ac027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:50:38Z,use_quota=True,user_id='f95ca26592674f9ab2f51c67af38d8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461e6371-422e-4d41-8587-2ecaf2624ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461e6371-422e-4d41-8587-2ecaf2624ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64713957-3ca8-4a51-8f3f-57a293863414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64713957-3ca8-4a51-8f3f-57a293863414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f90d157e-be86-422e-80fa-95bf9fdbf47a', 'volume_name': 'volume-f90d157e-be86-422e-80fa-95bf9fdbf47a', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3deebd-3422-4705-832f-eed4fe546804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3deebd-3422-4705-832f-eed4fe546804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b202eec8-8395-4d9e-ac2d-515590608296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:38 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Volume f90d157e-be86-422e-80fa-95bf9fdbf47a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f90d157e-be86-422e-80fa-95bf9fdbf47a', 'volume_size': 1}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1650170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90d157e-be86-422e-80fa-95bf9fdbf47a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e30a224950a4c9d98593f8d837ac027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:50:38Z,use_quota=True,user_id='f95ca26592674f9ab2f51c67af38d8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Creating volume f90d157e-be86-422e-80fa-95bf9fdbf47a {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 00:50:38 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f90d157e-be86-422e-80fa-95bf9fdbf47a 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:38 devstack quobyte-client[84147]: System call of process 84903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:50:38 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=4, name=volume-f90d157e-be86-422e-80fa-95bf9fdbf47a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f90d157e-be86-422e-80fa-95bf9fdbf47a 1073741824" returned: 0 in 0.435s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f90d157e-be86-422e-80fa-95bf9fdbf47a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f90d157e-be86-422e-80fa-95bf9fdbf47a" returned: 0 in 0.181s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] <== create_volume: return (753ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 00:50:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:50:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b202eec8-8395-4d9e-ac2d-515590608296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f90d157e-be86-422e-80fa-95bf9fdbf47a', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cede7a53-d6b0-4378-a499-07079bce6367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:39 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Volume volume-f90d157e-be86-422e-80fa-95bf9fdbf47a (f90d157e-be86-422e-80fa-95bf9fdbf47a): created successfully
Sep 18 00:50:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cede7a53-d6b0-4378-a499-07079bce6367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Flow 'volume_create_manager' (752eb2cc-02c4-46b5-a554-9bc4c6150dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:50:39 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-ca097a8e-2c0f-45bf-b049-3eae85850be8 tempest-TaggedBootDevicesTest-587649175 None] Created volume successfully.
Sep 18 00:50:40 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Flow 'volume_create_manager' (6df46d16-68a3-4955-b4d8-5bb0f3ebb1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce000774-f79d-472e-bb08-857dfc5ee001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce000774-f79d-472e-bb08-857dfc5ee001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1437417123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b5d91c-08fd-4a05-9b36-218eb6c1da16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e30a224950a4c9d98593f8d837ac027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:50:41Z,use_quota=True,user_id='f95ca26592674f9ab2f51c67af38d8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5e4e81-461a-40e8-833c-95d3de4ab175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5e4e81-461a-40e8-833c-95d3de4ab175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57fa3d46-eb0f-4984-a751-9ac59d14fb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57fa3d46-eb0f-4984-a751-9ac59d14fb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b5d91c-08fd-4a05-9b36-218eb6c1da16', 'volume_name': 'volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c977b769-7a9b-4bb9-a223-e60ee7a97aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c977b769-7a9b-4bb9-a223-e60ee7a97aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2d5cf0-b390-4780-812f-d20200d61e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:40 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Volume 01b5d91c-08fd-4a05-9b36-218eb6c1da16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16', 'volume_size': 1}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1437417123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b5d91c-08fd-4a05-9b36-218eb6c1da16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e30a224950a4c9d98593f8d837ac027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:50:41Z,use_quota=True,user_id='f95ca26592674f9ab2f51c67af38d8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Creating volume 01b5d91c-08fd-4a05-9b36-218eb6c1da16 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 00:50:40 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 00:50:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:41 devstack quobyte-client[84147]: System call of process 84908 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:50:41 devstack quobyte-client[84147]: System call of process 84908 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:50:41 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=5, name=volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 00:50:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16 1073741824" returned: 0 in 0.349s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16" returned: 0 in 0.096s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] <== create_volume: return (529ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 00:50:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.546s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:50:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2d5cf0-b390-4780-812f-d20200d61e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1e31a2-9b49-41db-81f7-438953aa7d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:50:41 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Volume volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16 (01b5d91c-08fd-4a05-9b36-218eb6c1da16): created successfully
Sep 18 00:50:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1e31a2-9b49-41db-81f7-438953aa7d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:50:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Flow 'volume_create_manager' (6df46d16-68a3-4955-b4d8-5bb0f3ebb1af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:50:41 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-ad7dd045-d352-4099-858b-772193c63322 tempest-TaggedBootDevicesTest-587649175 None] Created volume successfully.
Sep 18 00:50:51 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=15,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=12 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:50:51 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=9,cinder:DELETE=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:50:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:50:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:50:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:50:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:50:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:50:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:50:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:50:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.216s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:50:56 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:51:25 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:51:26 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:51:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-b912bf08-9ae5-49b3-ade2-504f3b19bb04 tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:51:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-b912bf08-9ae5-49b3-ade2-504f3b19bb04 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:51:48 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[33efc94c-38f0-4f01-b252-16a3812c2345]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:51:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-b912bf08-9ae5-49b3-ade2-504f3b19bb04 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:51:49 devstack quobyte-client[84147]: System call of process 85297 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:51:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-b912bf08-9ae5-49b3-ade2-504f3b19bb04 tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8" returned: 0 in 0.840s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:51:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-b912bf08-9ae5-49b3-ade2-504f3b19bb04 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:51:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-b912bf08-9ae5-49b3-ade2-504f3b19bb04 tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8" returned: 1 in 0.919s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:51:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-b912bf08-9ae5-49b3-ade2-504f3b19bb04 tempest-TaggedBootDevicesTest-587649175 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 00:51:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-b912bf08-9ae5-49b3-ade2-504f3b19bb04 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.113s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:51:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-4f3901af-724d-4b64-a35c-a6460a621292 req-b912bf08-9ae5-49b3-ade2-504f3b19bb04 tempest-TaggedBootDevicesTest-587649175 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '140858b8-85ea-4f92-80ab-837d01db54e9', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 00:51:51 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-b912bf08-9ae5-49b3-ade2-504f3b19bb04 tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:51:51 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-4f3901af-724d-4b64-a35c-a6460a621292 req-b912bf08-9ae5-49b3-ade2-504f3b19bb04 tempest-TaggedBootDevicesTest-587649175 None] attachment_update completed successfully.
Sep 18 00:51:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-a7e6f700-e7b5-4f72-9e6c-3b6fa0a6da87 tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:51:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-a7e6f700-e7b5-4f72-9e6c-3b6fa0a6da87 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:51:54 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[969883c3-605f-439c-8a6b-e59db943bd88]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:51:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-a7e6f700-e7b5-4f72-9e6c-3b6fa0a6da87 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f90d157e-be86-422e-80fa-95bf9fdbf47a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:51:55 devstack quobyte-client[84147]: System call of process 85313 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:51:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-a7e6f700-e7b5-4f72-9e6c-3b6fa0a6da87 tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f90d157e-be86-422e-80fa-95bf9fdbf47a" returned: 0 in 1.002s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:51:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-a7e6f700-e7b5-4f72-9e6c-3b6fa0a6da87 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.078s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:51:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-4f3901af-724d-4b64-a35c-a6460a621292 req-a7e6f700-e7b5-4f72-9e6c-3b6fa0a6da87 tempest-TaggedBootDevicesTest-587649175 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-f90d157e-be86-422e-80fa-95bf9fdbf47a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29362b64-b00c-44a8-af88-eab29e2eb810', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 00:51:55 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-a7e6f700-e7b5-4f72-9e6c-3b6fa0a6da87 tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:51:56 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-4f3901af-724d-4b64-a35c-a6460a621292 req-a7e6f700-e7b5-4f72-9e6c-3b6fa0a6da87 tempest-TaggedBootDevicesTest-587649175 None] attachment_update completed successfully.
Sep 18 00:51:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:51:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:51:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:51:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:51:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:51:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:51:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:51:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.111s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:51:56 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:51:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-6b1ade91-4878-43d6-90a9-9ea28f5eeed1 tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:51:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-6b1ade91-4878-43d6-90a9-9ea28f5eeed1 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:51:59 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[732d2d0f-7eee-47dd-817a-5783b9c1cf2c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:51:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-6b1ade91-4878-43d6-90a9-9ea28f5eeed1 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:52:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-6b1ade91-4878-43d6-90a9-9ea28f5eeed1 tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16" returned: 0 in 0.621s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:52:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-6b1ade91-4878-43d6-90a9-9ea28f5eeed1 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.699s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:52:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-4f3901af-724d-4b64-a35c-a6460a621292 req-6b1ade91-4878-43d6-90a9-9ea28f5eeed1 tempest-TaggedBootDevicesTest-587649175 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f42ba31e-0d9e-478c-b7ed-23cc72d6caac', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 00:52:00 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-4f3901af-724d-4b64-a35c-a6460a621292 req-6b1ade91-4878-43d6-90a9-9ea28f5eeed1 tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:52:00 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-4f3901af-724d-4b64-a35c-a6460a621292 req-6b1ade91-4878-43d6-90a9-9ea28f5eeed1 tempest-TaggedBootDevicesTest-587649175 None] attachment_update completed successfully.
Sep 18 00:52:10 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=17,cinder:UPDATE=4 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:52:10 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:52:14 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Flow 'volume_create_manager' (2ec03a95-026e-4d8f-951d-192474b2a17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e307849-087e-4441-999d-28fa87f36705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e307849-087e-4441-999d-28fa87f36705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-347582669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f476831d-c75f-4361-9466-386bdc106be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad7826594d34f6e8223e111b1cc2ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:52:14Z,use_quota=True,user_id='0c1b3df8eae84569a347310e007b9e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3385d5e3-aefd-415a-a124-58f6b392840e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3385d5e3-aefd-415a-a124-58f6b392840e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e716d2-704e-4e5f-add4-fb918f1c5721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e716d2-704e-4e5f-add4-fb918f1c5721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f476831d-c75f-4361-9466-386bdc106be5', 'volume_name': 'volume-f476831d-c75f-4361-9466-386bdc106be5', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770b8b10-2367-483e-987a-fd7bf308950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770b8b10-2367-483e-987a-fd7bf308950e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669c9022-83ac-4e98-8c4a-77f2d47c9b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:52:14 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Volume f476831d-c75f-4361-9466-386bdc106be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f476831d-c75f-4361-9466-386bdc106be5', 'volume_size': 1}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-347582669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f476831d-c75f-4361-9466-386bdc106be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad7826594d34f6e8223e111b1cc2ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:52:14Z,use_quota=True,user_id='0c1b3df8eae84569a347310e007b9e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Creating volume f476831d-c75f-4361-9466-386bdc106be5 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 00:52:14 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 00:52:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f476831d-c75f-4361-9466-386bdc106be5 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:52:15 devstack quobyte-client[84147]: System call of process 85538 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:52:15 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=6, name=volume-f476831d-c75f-4361-9466-386bdc106be5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 00:52:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f476831d-c75f-4361-9466-386bdc106be5 1073741824" returned: 0 in 1.129s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:52:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f476831d-c75f-4361-9466-386bdc106be5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:52:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f476831d-c75f-4361-9466-386bdc106be5" returned: 0 in 0.178s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:52:16 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] <== create_volume: return (1547ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 00:52:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:52:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669c9022-83ac-4e98-8c4a-77f2d47c9b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f476831d-c75f-4361-9466-386bdc106be5', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:52:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19ec142-36b2-41cf-bd02-0ffe8c2b4598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:52:17 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Volume volume-f476831d-c75f-4361-9466-386bdc106be5 (f476831d-c75f-4361-9466-386bdc106be5): created successfully
Sep 18 00:52:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19ec142-36b2-41cf-bd02-0ffe8c2b4598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:52:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Flow 'volume_create_manager' (2ec03a95-026e-4d8f-951d-192474b2a17d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:52:17 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-0c73fa7d-8a73-4093-96e8-f50e52003178 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Created volume successfully.
Sep 18 00:52:27 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:52:27 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:52:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-afb5201f-90a3-4405-8fdb-8c4c7b4eb2e9 req-ffc874ee-9f99-450e-8041-b9bf93ca3f93 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:52:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-afb5201f-90a3-4405-8fdb-8c4c7b4eb2e9 req-ffc874ee-9f99-450e-8041-b9bf93ca3f93 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.025s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:52:31 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13b3ccb-cd91-4f58-bccf-b55a1c02e8dc]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:52:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-afb5201f-90a3-4405-8fdb-8c4c7b4eb2e9 req-ffc874ee-9f99-450e-8041-b9bf93ca3f93 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f476831d-c75f-4361-9466-386bdc106be5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:52:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-afb5201f-90a3-4405-8fdb-8c4c7b4eb2e9 req-ffc874ee-9f99-450e-8041-b9bf93ca3f93 tempest-AttachSCSIVolumeTestJSON-1117493819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f476831d-c75f-4361-9466-386bdc106be5" returned: 0 in 1.736s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:52:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-afb5201f-90a3-4405-8fdb-8c4c7b4eb2e9 req-ffc874ee-9f99-450e-8041-b9bf93ca3f93 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.941s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:52:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-afb5201f-90a3-4405-8fdb-8c4c7b4eb2e9 req-ffc874ee-9f99-450e-8041-b9bf93ca3f93 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-f476831d-c75f-4361-9466-386bdc106be5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f63fa86c-803f-464a-85f0-46b4a00d5467', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 00:52:33 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-afb5201f-90a3-4405-8fdb-8c4c7b4eb2e9 req-ffc874ee-9f99-450e-8041-b9bf93ca3f93 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:52:34 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-afb5201f-90a3-4405-8fdb-8c4c7b4eb2e9 req-ffc874ee-9f99-450e-8041-b9bf93ca3f93 tempest-AttachSCSIVolumeTestJSON-1117493819 None] attachment_update completed successfully.
Sep 18 00:52:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-114da5fe-07df-4bf9-a56d-ac0af77b0d9b req-14f392b4-5356-440d-a664-51d2f437095b tempest-VolumesAssistedSnapshotsTest-1953327583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:52:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-114da5fe-07df-4bf9-a56d-ac0af77b0d9b req-14f392b4-5356-440d-a664-51d2f437095b tempest-VolumesAssistedSnapshotsTest-1953327583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:52:34 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d61b0de-0bb1-4bdb-b332-1ca8e3f739fe]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:52:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-114da5fe-07df-4bf9-a56d-ac0af77b0d9b req-14f392b4-5356-440d-a664-51d2f437095b tempest-VolumesAssistedSnapshotsTest-1953327583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:52:35 devstack quobyte-client[84147]: System call of process 86195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:52:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-114da5fe-07df-4bf9-a56d-ac0af77b0d9b req-14f392b4-5356-440d-a664-51d2f437095b tempest-VolumesAssistedSnapshotsTest-1953327583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d" returned: 0 in 1.445s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:52:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-114da5fe-07df-4bf9-a56d-ac0af77b0d9b req-14f392b4-5356-440d-a664-51d2f437095b tempest-VolumesAssistedSnapshotsTest-1953327583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.651s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:52:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-114da5fe-07df-4bf9-a56d-ac0af77b0d9b req-14f392b4-5356-440d-a664-51d2f437095b tempest-VolumesAssistedSnapshotsTest-1953327583 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a2bf379-996e-4dbf-aeed-9a4a6f3a942e', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 00:52:36 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-114da5fe-07df-4bf9-a56d-ac0af77b0d9b req-14f392b4-5356-440d-a664-51d2f437095b tempest-VolumesAssistedSnapshotsTest-1953327583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:52:37 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-114da5fe-07df-4bf9-a56d-ac0af77b0d9b req-14f392b4-5356-440d-a664-51d2f437095b tempest-VolumesAssistedSnapshotsTest-1953327583 None] attachment_update completed successfully.
Sep 18 00:52:47 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:52:47 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:52:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:52:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:52:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:52:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:52:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:52:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:52:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:52:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.126s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:52:56 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:53:07 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-25336dd6-1873-469f-8684-ee0313a44079 req-1f2520e8-6606-42d5-9c21-971a08158df1 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:53:07 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-25336dd6-1873-469f-8684-ee0313a44079 req-1f2520e8-6606-42d5-9c21-971a08158df1 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:53:07 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-25336dd6-1873-469f-8684-ee0313a44079 req-1f2520e8-6606-42d5-9c21-971a08158df1 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Terminate volume connection completed successfully.
Sep 18 00:53:07 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-25336dd6-1873-469f-8684-ee0313a44079 req-1f2520e8-6606-42d5-9c21-971a08158df1 tempest-AttachSCSIVolumeTestJSON-1117493819 None] Deleting attachment f63fa86c-803f-464a-85f0-46b4a00d5467. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 00:53:10 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-faa9e194-fd50-4743-bc0e-68c7d9838fd1 req-a76efd8c-777e-474c-8e93-0d36783a0b8b tempest-VolumesAssistedSnapshotsTest-1953327583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:53:10 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-faa9e194-fd50-4743-bc0e-68c7d9838fd1 req-a76efd8c-777e-474c-8e93-0d36783a0b8b tempest-VolumesAssistedSnapshotsTest-1953327583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:53:10 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-faa9e194-fd50-4743-bc0e-68c7d9838fd1 req-a76efd8c-777e-474c-8e93-0d36783a0b8b tempest-VolumesAssistedSnapshotsTest-1953327583 None] Terminate volume connection completed successfully.
Sep 18 00:53:10 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-faa9e194-fd50-4743-bc0e-68c7d9838fd1 req-a76efd8c-777e-474c-8e93-0d36783a0b8b tempest-VolumesAssistedSnapshotsTest-1953327583 None] Deleting attachment 3a2bf379-996e-4dbf-aeed-9a4a6f3a942e. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 00:53:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Acquiring lock "cinder-4b220abd-ff02-478a-b04f-26a0d4bcbf5d-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 00:53:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Lock "cinder-4b220abd-ff02-478a-b04f-26a0d4bcbf5d-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 00:53:12 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:53:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Acquiring lock "cinder-quobyte-4b220abd-ff02-478a-b04f-26a0d4bcbf5d" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 00:53:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Lock "cinder-quobyte-4b220abd-ff02-478a-b04f-26a0d4bcbf5d" acquired by "delete_volume" :: waited 0.035s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 00:53:12 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b81f25-7b8b-4489-b510-c2eab384cd6f]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:53:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:53:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d" returned: 0 in 0.532s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:53:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:53:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b220abd-ff02-478a-b04f-26a0d4bcbf5d" returned: 0 in 0.111s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:53:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Lock "cinder-quobyte-4b220abd-ff02-478a-b04f-26a0d4bcbf5d" released by "delete_volume" :: held 0.852s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 00:53:14 devstack cinder-volume[84134]: WARNING cinder.quota [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 18 00:53:14 devstack cinder-volume[84134]: WARNING cinder.quota [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 18 00:53:14 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Created reservations ['682947b2-67f1-45e5-8fe5-e9767147d643', '50875a25-c674-4455-9d56-84c2786c60a9', 'ef331a47-d5d7-402c-9d4f-4d663d372893', '699302d6-4334-42ed-a215-21b969a17957'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 00:53:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:53:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:53:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:53:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:53:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:53:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:53:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.326s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:53:15 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:53:15 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Deleted volume successfully.
Sep 18 00:53:15 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3fecd490-7d5a-4dad-8dff-cdfc6b4c9a76 tempest-VolumesAssistedSnapshotsTest-1953327583 None] Lock "cinder-4b220abd-ff02-478a-b04f-26a0d4bcbf5d-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 00:53:25 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:53:25 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=7 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:53:28 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Acquiring lock "cinder-f476831d-c75f-4361-9466-386bdc106be5-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 00:53:28 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Lock "cinder-f476831d-c75f-4361-9466-386bdc106be5-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 00:53:28 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:53:28 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Acquiring lock "cinder-quobyte-f476831d-c75f-4361-9466-386bdc106be5" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 00:53:28 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Lock "cinder-quobyte-f476831d-c75f-4361-9466-386bdc106be5" acquired by "delete_volume" :: waited 0.052s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 00:53:28 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c4e413-26b1-416d-a291-fab5acc5b7c8]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:53:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f476831d-c75f-4361-9466-386bdc106be5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:53:29 devstack quobyte-client[84147]: System call of process 86454 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:53:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f476831d-c75f-4361-9466-386bdc106be5" returned: 0 in 0.987s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:53:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f476831d-c75f-4361-9466-386bdc106be5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:53:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f476831d-c75f-4361-9466-386bdc106be5" returned: 0 in 0.227s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:53:30 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Lock "cinder-quobyte-f476831d-c75f-4361-9466-386bdc106be5" released by "delete_volume" :: held 1.592s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 00:53:30 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Created reservations ['0c2d1115-387a-4f12-894b-70782b13b35f', 'ebd395c0-4e68-43ea-8c3a-6f0fe63f686b', '0a9815f3-799e-4efd-ad9c-9c6d09a62df0', 'cd9867cb-9c6a-47f4-9703-c0dd4cbfa400'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 00:53:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:53:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:53:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:53:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:53:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:53:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:53:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.452s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:53:31 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:53:32 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Deleted volume successfully.
Sep 18 00:53:32 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2fc5b6ea-9c98-4ed4-b548-69940ccd3b4c tempest-AttachSCSIVolumeTestJSON-1117493819 None] Lock "cinder-f476831d-c75f-4361-9466-386bdc106be5-delete_volume" released by "delete_volume" :: held 4.745s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 00:53:40 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=10 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:53:42 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=6,cinder:SELECT=6,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:53:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:53:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:53:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:53:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:53:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:53:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:53:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:53:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.140s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:53:56 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:54:41 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-796a4621-56c9-464f-81b4-7de8f51029e6 req-d12a8e88-5e3b-4e3b-b5ec-b69b0f1e4da0 tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:54:41 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-796a4621-56c9-464f-81b4-7de8f51029e6 req-d12a8e88-5e3b-4e3b-b5ec-b69b0f1e4da0 tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:54:41 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-796a4621-56c9-464f-81b4-7de8f51029e6 req-d12a8e88-5e3b-4e3b-b5ec-b69b0f1e4da0 tempest-TaggedBootDevicesTest-587649175 None] Terminate volume connection completed successfully.
Sep 18 00:54:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-796a4621-56c9-464f-81b4-7de8f51029e6 req-d12a8e88-5e3b-4e3b-b5ec-b69b0f1e4da0 tempest-TaggedBootDevicesTest-587649175 None] Deleting attachment 140858b8-85ea-4f92-80ab-837d01db54e9. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 00:54:42 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-796a4621-56c9-464f-81b4-7de8f51029e6 req-70266628-b828-4549-97b4-d4b2fae53bbf tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:54:42 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-796a4621-56c9-464f-81b4-7de8f51029e6 req-70266628-b828-4549-97b4-d4b2fae53bbf tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:54:42 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-796a4621-56c9-464f-81b4-7de8f51029e6 req-70266628-b828-4549-97b4-d4b2fae53bbf tempest-TaggedBootDevicesTest-587649175 None] Terminate volume connection completed successfully.
Sep 18 00:54:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-796a4621-56c9-464f-81b4-7de8f51029e6 req-70266628-b828-4549-97b4-d4b2fae53bbf tempest-TaggedBootDevicesTest-587649175 None] Deleting attachment 29362b64-b00c-44a8-af88-eab29e2eb810. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 00:54:43 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-796a4621-56c9-464f-81b4-7de8f51029e6 req-34e58605-86ac-415e-9fbc-2fed31e3fdf2 tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:54:43 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-796a4621-56c9-464f-81b4-7de8f51029e6 req-34e58605-86ac-415e-9fbc-2fed31e3fdf2 tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:54:43 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-796a4621-56c9-464f-81b4-7de8f51029e6 req-34e58605-86ac-415e-9fbc-2fed31e3fdf2 tempest-TaggedBootDevicesTest-587649175 None] Terminate volume connection completed successfully.
Sep 18 00:54:43 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-796a4621-56c9-464f-81b4-7de8f51029e6 req-34e58605-86ac-415e-9fbc-2fed31e3fdf2 tempest-TaggedBootDevicesTest-587649175 None] Deleting attachment f42ba31e-0d9e-478c-b7ed-23cc72d6caac. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 00:54:52 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=3 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:54:53 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=3 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:54:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "cinder-01b5d91c-08fd-4a05-9b36-218eb6c1da16-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 00:54:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Lock "cinder-01b5d91c-08fd-4a05-9b36-218eb6c1da16-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 00:54:55 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:54:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "cinder-quobyte-01b5d91c-08fd-4a05-9b36-218eb6c1da16" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 00:54:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Lock "cinder-quobyte-01b5d91c-08fd-4a05-9b36-218eb6c1da16" acquired by "delete_volume" :: waited 0.027s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 00:54:55 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aebad36-d528-453d-9390-3c6855a6de92]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:54:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:54:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16" returned: 0 in 0.703s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:54:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:54:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:54:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:54:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.028s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:54:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:54:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:54:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:54:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:54:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-01b5d91c-08fd-4a05-9b36-218eb6c1da16" returned: 0 in 0.560s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:54:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Lock "cinder-quobyte-01b5d91c-08fd-4a05-9b36-218eb6c1da16" released by "delete_volume" :: held 1.625s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 00:54:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.446s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:54:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:54:57 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Created reservations ['21b232ed-6b1d-46cc-8b2d-7cd3463cee75', '97ada3a7-f947-4ed8-a014-fcb7541783b5', 'db6dd58e-cd4e-43f8-9d2b-75b5fbce295a', '8f7a9c79-2e95-41bb-9487-321f4bd6e730'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 00:54:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:54:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:54:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:54:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:54:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:54:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:54:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.241s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:54:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:54:57 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Deleted volume successfully.
Sep 18 00:54:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a0912e75-4b43-4279-af5f-8dcfdd6a723e tempest-TaggedBootDevicesTest-587649175 None] Lock "cinder-01b5d91c-08fd-4a05-9b36-218eb6c1da16-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 00:54:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "cinder-f90d157e-be86-422e-80fa-95bf9fdbf47a-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 00:54:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Lock "cinder-f90d157e-be86-422e-80fa-95bf9fdbf47a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 00:54:59 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:54:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "cinder-quobyte-f90d157e-be86-422e-80fa-95bf9fdbf47a" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 00:54:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Lock "cinder-quobyte-f90d157e-be86-422e-80fa-95bf9fdbf47a" acquired by "delete_volume" :: waited 0.035s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 00:54:59 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5060fa6-d0ed-4ab9-85fc-39cdc03ddab6]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:54:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f90d157e-be86-422e-80fa-95bf9fdbf47a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:55:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f90d157e-be86-422e-80fa-95bf9fdbf47a" returned: 0 in 1.036s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:55:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f90d157e-be86-422e-80fa-95bf9fdbf47a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:55:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f90d157e-be86-422e-80fa-95bf9fdbf47a" returned: 0 in 0.179s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:55:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Lock "cinder-quobyte-f90d157e-be86-422e-80fa-95bf9fdbf47a" released by "delete_volume" :: held 1.496s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 00:55:02 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Created reservations ['753eb643-a1ec-4553-ab95-a3963a9a036d', 'a9fadedf-4427-4674-a48b-6b6728b54a2d', 'db47b4fe-81ac-44ae-9266-06681718b5f2', '71950acf-e0fa-43e4-bb55-85afaf15357f'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 00:55:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:55:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:55:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:55:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:55:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:55:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:55:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.387s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:55:03 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:55:03 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Deleted volume successfully.
Sep 18 00:55:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "cinder-a44e6a86-824d-4bcc-a6db-5f085758f0d8-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 00:55:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b465d899-6e44-4f14-b3b6-a129baa3b15d tempest-TaggedBootDevicesTest-587649175 None] Lock "cinder-f90d157e-be86-422e-80fa-95bf9fdbf47a-delete_volume" released by "delete_volume" :: held 4.543s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 00:55:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Lock "cinder-a44e6a86-824d-4bcc-a6db-5f085758f0d8-delete_volume" acquired by "delete_volume" :: waited 0.251s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 00:55:04 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:55:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "cinder-quobyte-a44e6a86-824d-4bcc-a6db-5f085758f0d8" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 00:55:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Lock "cinder-quobyte-a44e6a86-824d-4bcc-a6db-5f085758f0d8" acquired by "delete_volume" :: waited 0.025s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 00:55:04 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bbe38f-5e24-459c-9e65-8960f76570bb]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:55:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:55:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8" returned: 0 in 0.639s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:55:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:55:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8" returned: 1 in 0.750s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:55:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 00:55:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:55:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a44e6a86-824d-4bcc-a6db-5f085758f0d8" returned: 0 in 0.159s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:55:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Lock "cinder-quobyte-a44e6a86-824d-4bcc-a6db-5f085758f0d8" released by "delete_volume" :: held 2.023s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 00:55:07 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Created reservations ['037e77c1-ffb7-40a3-b09d-a536235b934d', '2f0387ee-2d2d-45a6-8b23-e15ccebcc496', '3a2b510d-864f-4896-8da1-eb734ad7c841', 'f25f3661-ff0e-4470-8959-970291474d28'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 00:55:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:55:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:55:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:55:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:55:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:55:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:55:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.110s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:55:07 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:55:07 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Deleted volume successfully.
Sep 18 00:55:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5e0f7fdb-b276-41a5-ad2a-7261413800e6 tempest-TaggedBootDevicesTest-587649175 None] Lock "cinder-a44e6a86-824d-4bcc-a6db-5f085758f0d8-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 00:55:25 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=11,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:55:25 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=27,cinder:SELECT=20,cinder:INSERT=11,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:55:38 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Flow 'volume_create_manager' (d0c095a9-2f2c-40af-9513-bbc6506b3ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87c5c43-ec9f-4a3f-8faa-9a116a774e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87c5c43-ec9f-4a3f-8faa-9a116a774e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-207632145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b1b7c3-0a77-4efe-aade-b6390d3758d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a730254972448a1844f7a6e5650a654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:55:38Z,use_quota=True,user_id='518eb89b82be4144986d560f51fe7bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ffb07d-84e0-4e69-9aea-0b9fb4845385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ffb07d-84e0-4e69-9aea-0b9fb4845385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50b5d1c-eee9-4841-878b-3473ab9d951a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50b5d1c-eee9-4841-878b-3473ab9d951a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b1b7c3-0a77-4efe-aade-b6390d3758d3', 'volume_name': 'volume-90b1b7c3-0a77-4efe-aade-b6390d3758d3', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b126c6-9e4b-4032-b590-edec4b5c4bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b126c6-9e4b-4032-b590-edec4b5c4bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd13ae0-ebbe-44e9-8fca-aa3cb9f79a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:55:38 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Volume 90b1b7c3-0a77-4efe-aade-b6390d3758d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b1b7c3-0a77-4efe-aade-b6390d3758d3', 'volume_size': 1}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-207632145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b1b7c3-0a77-4efe-aade-b6390d3758d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a730254972448a1844f7a6e5650a654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:55:38Z,use_quota=True,user_id='518eb89b82be4144986d560f51fe7bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Creating volume 90b1b7c3-0a77-4efe-aade-b6390d3758d3 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 00:55:38 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 00:55:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-90b1b7c3-0a77-4efe-aade-b6390d3758d3 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:55:38 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=7, name=volume-90b1b7c3-0a77-4efe-aade-b6390d3758d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 00:55:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-90b1b7c3-0a77-4efe-aade-b6390d3758d3 1073741824" returned: 0 in 0.655s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:55:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-90b1b7c3-0a77-4efe-aade-b6390d3758d3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:55:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-90b1b7c3-0a77-4efe-aade-b6390d3758d3" returned: 0 in 0.204s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:55:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] <== create_volume: return (1094ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 00:55:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:55:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd13ae0-ebbe-44e9-8fca-aa3cb9f79a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b1b7c3-0a77-4efe-aade-b6390d3758d3', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:55:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0eca51-993c-4c86-9830-ab0222dac40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:55:40 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Volume volume-90b1b7c3-0a77-4efe-aade-b6390d3758d3 (90b1b7c3-0a77-4efe-aade-b6390d3758d3): created successfully
Sep 18 00:55:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0eca51-993c-4c86-9830-ab0222dac40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:55:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Flow 'volume_create_manager' (d0c095a9-2f2c-40af-9513-bbc6506b3ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:55:40 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-c0da8ae7-3f40-41ae-9b93-ba2fcca036c2 tempest-VolumesAdminNegativeTest-540197058 None] Created volume successfully.
Sep 18 00:55:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Acquiring lock "cinder-90b1b7c3-0a77-4efe-aade-b6390d3758d3-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 00:55:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Lock "cinder-90b1b7c3-0a77-4efe-aade-b6390d3758d3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 00:55:42 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:55:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Acquiring lock "cinder-quobyte-90b1b7c3-0a77-4efe-aade-b6390d3758d3" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 00:55:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Lock "cinder-quobyte-90b1b7c3-0a77-4efe-aade-b6390d3758d3" acquired by "delete_volume" :: waited 0.053s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 00:55:43 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[59af183b-187a-49a0-b9a2-692d6d1dbbf1]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:55:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-90b1b7c3-0a77-4efe-aade-b6390d3758d3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:55:43 devstack quobyte-client[84147]: System call of process 87710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:55:43 devstack quobyte-client[84147]: System call of process 87710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:55:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-90b1b7c3-0a77-4efe-aade-b6390d3758d3" returned: 0 in 1.022s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:55:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-90b1b7c3-0a77-4efe-aade-b6390d3758d3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:55:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-90b1b7c3-0a77-4efe-aade-b6390d3758d3" returned: 0 in 0.273s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:55:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Lock "cinder-quobyte-90b1b7c3-0a77-4efe-aade-b6390d3758d3" released by "delete_volume" :: held 1.525s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 00:55:44 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Created reservations ['7d2bd3bd-1848-480c-a345-896ff350420c', '76210479-c4c6-4164-89f7-7a99749e9a58', '0eec6f43-5b46-48c3-9265-c6d3e56d946e', 'bcfa5711-5fe7-47bd-90cd-2e3bd5c5779e'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 00:55:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:55:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:55:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:55:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:55:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:55:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:55:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.445s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:55:46 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:55:46 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Deleted volume successfully.
Sep 18 00:55:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eca2cde3-3e18-4d81-90c2-05dfe221506d tempest-VolumesAdminNegativeTest-540197058 None] Lock "cinder-90b1b7c3-0a77-4efe-aade-b6390d3758d3-delete_volume" released by "delete_volume" :: held 4.773s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 00:55:55 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=5,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:55:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:55:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:55:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:55:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:55:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:55:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:55:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:55:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.376s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:55:56 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:55:56 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=8,cinder:SELECT=7,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:56:04 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:56:04 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Flow 'volume_create_manager' (2e479a2d-3b2d-4a19-b9fd-efebf41cb8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb24cd0-71f3-4df5-bc6f-730f2707d551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb24cd0-71f3-4df5-bc6f-730f2707d551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-91160778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4067346-df76-417b-be3a-621ce8a7dca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5dc422bae3d4b65abf84019aa11beb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:56:05Z,use_quota=True,user_id='b0adbf92feb848e58fe5dd566913ee0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da066e3-279e-41ed-8179-6a777a7090e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da066e3-279e-41ed-8179-6a777a7090e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfb40b9-db39-4148-8079-429ea005a9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfb40b9-db39-4148-8079-429ea005a9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4067346-df76-417b-be3a-621ce8a7dca6', 'volume_name': 'volume-e4067346-df76-417b-be3a-621ce8a7dca6', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfec9b6-fedf-408f-84d9-cbfbc8ccdf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfec9b6-fedf-408f-84d9-cbfbc8ccdf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37d4d26-d9c7-4a2c-a3a3-ea4eb6d6369a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:56:05 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Volume e4067346-df76-417b-be3a-621ce8a7dca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4067346-df76-417b-be3a-621ce8a7dca6', 'volume_size': 1}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-91160778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4067346-df76-417b-be3a-621ce8a7dca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5dc422bae3d4b65abf84019aa11beb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:56:05Z,use_quota=True,user_id='b0adbf92feb848e58fe5dd566913ee0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Creating volume e4067346-df76-417b-be3a-621ce8a7dca6 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 00:56:05 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e4067346-df76-417b-be3a-621ce8a7dca6 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:56:05 devstack quobyte-client[84147]: System call of process 87780 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:56:05 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=8, name=volume-e4067346-df76-417b-be3a-621ce8a7dca6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e4067346-df76-417b-be3a-621ce8a7dca6 1073741824" returned: 0 in 0.519s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:56:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e4067346-df76-417b-be3a-621ce8a7dca6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:56:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e4067346-df76-417b-be3a-621ce8a7dca6" returned: 0 in 0.139s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:56:06 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] <== create_volume: return (774ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 00:56:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:56:06 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37d4d26-d9c7-4a2c-a3a3-ea4eb6d6369a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4067346-df76-417b-be3a-621ce8a7dca6', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:56:06 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee5d278-2c00-461e-a15b-8158dc0e580c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:56:06 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Volume volume-e4067346-df76-417b-be3a-621ce8a7dca6 (e4067346-df76-417b-be3a-621ce8a7dca6): created successfully
Sep 18 00:56:06 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee5d278-2c00-461e-a15b-8158dc0e580c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:56:06 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Flow 'volume_create_manager' (2e479a2d-3b2d-4a19-b9fd-efebf41cb8aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:56:06 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-9e323ce2-8669-42b2-be8d-60e27c9959bc tempest-AttachVolumeShelveTestJSON-182342665 None] Created volume successfully.
Sep 18 00:56:16 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:56:16 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:56:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-44bca99a-2681-41b6-a77b-424c7d022dd2 req-f1f32573-fc4d-4e9e-a510-55d9193e2fc6 tempest-AttachVolumeShelveTestJSON-182342665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:56:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-44bca99a-2681-41b6-a77b-424c7d022dd2 req-f1f32573-fc4d-4e9e-a510-55d9193e2fc6 tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:56:45 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecec592-c6aa-445b-919f-e6ac5de54397]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:56:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-44bca99a-2681-41b6-a77b-424c7d022dd2 req-f1f32573-fc4d-4e9e-a510-55d9193e2fc6 tempest-AttachVolumeShelveTestJSON-182342665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e4067346-df76-417b-be3a-621ce8a7dca6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:56:46 devstack quobyte-client[84147]: System call of process 88028 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:56:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-44bca99a-2681-41b6-a77b-424c7d022dd2 req-f1f32573-fc4d-4e9e-a510-55d9193e2fc6 tempest-AttachVolumeShelveTestJSON-182342665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e4067346-df76-417b-be3a-621ce8a7dca6" returned: 0 in 1.343s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:56:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-44bca99a-2681-41b6-a77b-424c7d022dd2 req-f1f32573-fc4d-4e9e-a510-55d9193e2fc6 tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.471s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:56:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-44bca99a-2681-41b6-a77b-424c7d022dd2 req-f1f32573-fc4d-4e9e-a510-55d9193e2fc6 tempest-AttachVolumeShelveTestJSON-182342665 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-e4067346-df76-417b-be3a-621ce8a7dca6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47f9f15a-7447-4184-92ba-72edf84a274a', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 00:56:47 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-44bca99a-2681-41b6-a77b-424c7d022dd2 req-f1f32573-fc4d-4e9e-a510-55d9193e2fc6 tempest-AttachVolumeShelveTestJSON-182342665 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:56:47 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-44bca99a-2681-41b6-a77b-424c7d022dd2 req-f1f32573-fc4d-4e9e-a510-55d9193e2fc6 tempest-AttachVolumeShelveTestJSON-182342665 None] attachment_update completed successfully.
Sep 18 00:56:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:56:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:56:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:56:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:56:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:56:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:56:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:56:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.124s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:56:56 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:56:57 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:56:58 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:57:24 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Flow 'volume_create_manager' (af4815f2-4ee0-4a2e-9263-a180f619636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5b57b4-6724-4c69-82be-462b9419e998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5b57b4-6724-4c69-82be-462b9419e998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-781431768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4ba799-53ca-437c-96ac-ddfdc288c345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='809e4f914e0c461fa83e4450cd17e636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:57:24Z,use_quota=True,user_id='ca1990d9ca554aeab595b0d056901ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d351257-6e2e-4343-a050-472d741afd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d351257-6e2e-4343-a050-472d741afd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990b8520-91f7-480b-a52f-0ef36e590fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990b8520-91f7-480b-a52f-0ef36e590fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e4ba799-53ca-437c-96ac-ddfdc288c345', 'volume_name': 'volume-9e4ba799-53ca-437c-96ac-ddfdc288c345', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44621f41-9c7f-4c28-8c19-464a755b6614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44621f41-9c7f-4c28-8c19-464a755b6614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb70ffd9-63dd-4870-b40a-ab8681d14efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:57:24 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Volume 9e4ba799-53ca-437c-96ac-ddfdc288c345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e4ba799-53ca-437c-96ac-ddfdc288c345', 'volume_size': 1}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-781431768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4ba799-53ca-437c-96ac-ddfdc288c345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='809e4f914e0c461fa83e4450cd17e636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:57:24Z,use_quota=True,user_id='ca1990d9ca554aeab595b0d056901ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Creating volume 9e4ba799-53ca-437c-96ac-ddfdc288c345 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 00:57:24 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 00:57:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9e4ba799-53ca-437c-96ac-ddfdc288c345 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:57:25 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=9, name=volume-9e4ba799-53ca-437c-96ac-ddfdc288c345, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 00:57:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9e4ba799-53ca-437c-96ac-ddfdc288c345 1073741824" returned: 0 in 0.738s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:57:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9e4ba799-53ca-437c-96ac-ddfdc288c345 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:57:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9e4ba799-53ca-437c-96ac-ddfdc288c345" returned: 0 in 0.116s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:57:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] <== create_volume: return (944ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 00:57:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:57:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb70ffd9-63dd-4870-b40a-ab8681d14efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e4ba799-53ca-437c-96ac-ddfdc288c345', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:57:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75562cca-41d5-49ed-8ef9-45435c999b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:57:25 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Volume volume-9e4ba799-53ca-437c-96ac-ddfdc288c345 (9e4ba799-53ca-437c-96ac-ddfdc288c345): created successfully
Sep 18 00:57:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75562cca-41d5-49ed-8ef9-45435c999b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:57:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Flow 'volume_create_manager' (af4815f2-4ee0-4a2e-9263-a180f619636c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:57:26 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-9bc4210c-f3f4-4cf9-9f8c-8766af694b96 tempest-DeleteServersTestJSON-227710296 None] Created volume successfully.
Sep 18 00:57:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-ba567456-b6a2-4f5a-b1d8-e960a6457284 req-86ecc3d8-3e05-4eca-9ca8-6b179560253f tempest-DeleteServersTestJSON-227710296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:57:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-ba567456-b6a2-4f5a-b1d8-e960a6457284 req-86ecc3d8-3e05-4eca-9ca8-6b179560253f tempest-DeleteServersTestJSON-227710296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:57:31 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6440b4-ee7b-44d0-a19e-56c104abe448]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:57:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ba567456-b6a2-4f5a-b1d8-e960a6457284 req-86ecc3d8-3e05-4eca-9ca8-6b179560253f tempest-DeleteServersTestJSON-227710296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9e4ba799-53ca-437c-96ac-ddfdc288c345 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:57:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ba567456-b6a2-4f5a-b1d8-e960a6457284 req-86ecc3d8-3e05-4eca-9ca8-6b179560253f tempest-DeleteServersTestJSON-227710296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9e4ba799-53ca-437c-96ac-ddfdc288c345" returned: 0 in 0.625s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:57:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-ba567456-b6a2-4f5a-b1d8-e960a6457284 req-86ecc3d8-3e05-4eca-9ca8-6b179560253f tempest-DeleteServersTestJSON-227710296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.707s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:57:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-ba567456-b6a2-4f5a-b1d8-e960a6457284 req-86ecc3d8-3e05-4eca-9ca8-6b179560253f tempest-DeleteServersTestJSON-227710296 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-9e4ba799-53ca-437c-96ac-ddfdc288c345', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ead11f2e-e3bf-4912-af44-c576becac02c', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 00:57:31 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-ba567456-b6a2-4f5a-b1d8-e960a6457284 req-86ecc3d8-3e05-4eca-9ca8-6b179560253f tempest-DeleteServersTestJSON-227710296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:57:32 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-ba567456-b6a2-4f5a-b1d8-e960a6457284 req-86ecc3d8-3e05-4eca-9ca8-6b179560253f tempest-DeleteServersTestJSON-227710296 None] attachment_update completed successfully.
Sep 18 00:57:42 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:57:42 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:57:45 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Flow 'volume_create_manager' (3c6dddbf-0ff7-4a04-bc33-8e5a67a79d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad855ea-0ff2-4476-b1e5-1ae75f354083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad855ea-0ff2-4476-b1e5-1ae75f354083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-199123968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad610d3-4fb1-4e18-9b01-b2d37f5007f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e8e44d94d14a968dfd2173c0a5a55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:57:45Z,use_quota=True,user_id='21f18bdd55034de4963e9fc8907fd444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1becf107-eb10-4da2-bc0b-b77c0f3eb3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1becf107-eb10-4da2-bc0b-b77c0f3eb3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8205eff4-043d-4352-bba1-038eff8108c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8205eff4-043d-4352-bba1-038eff8108c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad610d3-4fb1-4e18-9b01-b2d37f5007f0', 'volume_name': 'volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940ee306-917e-49df-9ea4-41db57b445cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940ee306-917e-49df-9ea4-41db57b445cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674cf623-6e3f-4ee3-8b06-b9dcd40d41b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:57:45 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Volume 9ad610d3-4fb1-4e18-9b01-b2d37f5007f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0', 'volume_size': 1}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-199123968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad610d3-4fb1-4e18-9b01-b2d37f5007f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e8e44d94d14a968dfd2173c0a5a55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:57:45Z,use_quota=True,user_id='21f18bdd55034de4963e9fc8907fd444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Creating volume 9ad610d3-4fb1-4e18-9b01-b2d37f5007f0 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 00:57:45 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 00:57:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:57:45 devstack quobyte-client[84147]: System call of process 88845 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:57:45 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=10, name=volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 00:57:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0 1073741824" returned: 0 in 0.930s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:57:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:57:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0" returned: 0 in 0.289s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:57:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] <== create_volume: return (1543ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 00:57:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:57:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674cf623-6e3f-4ee3-8b06-b9dcd40d41b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:57:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c889cea0-e408-4f15-b58b-c38c74fb3d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:57:47 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Volume volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0 (9ad610d3-4fb1-4e18-9b01-b2d37f5007f0): created successfully
Sep 18 00:57:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c889cea0-e408-4f15-b58b-c38c74fb3d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:57:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Flow 'volume_create_manager' (3c6dddbf-0ff7-4a04-bc33-8e5a67a79d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:57:48 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-2eaabe52-8935-4798-b259-8843e87bb39b tempest-AttachVolumeTestJSON-1539607517 None] Created volume successfully.
Sep 18 00:57:49 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-d97ab28d-1f04-4211-954a-dcbbe73701ab req-e1dc12cd-a586-47e1-8341-4a394c66254f tempest-DeleteServersTestJSON-227710296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:57:49 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-d97ab28d-1f04-4211-954a-dcbbe73701ab req-e1dc12cd-a586-47e1-8341-4a394c66254f tempest-DeleteServersTestJSON-227710296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:57:49 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-d97ab28d-1f04-4211-954a-dcbbe73701ab req-e1dc12cd-a586-47e1-8341-4a394c66254f tempest-DeleteServersTestJSON-227710296 None] Terminate volume connection completed successfully.
Sep 18 00:57:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-d97ab28d-1f04-4211-954a-dcbbe73701ab req-e1dc12cd-a586-47e1-8341-4a394c66254f tempest-DeleteServersTestJSON-227710296 None] Deleting attachment ead11f2e-e3bf-4912-af44-c576becac02c. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 00:57:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-9273e91d-2740-4500-9b91-3d5dc7c41103 req-651f6c53-9ec3-4b36-bc57-4b67ab4622a3 tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:57:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-9273e91d-2740-4500-9b91-3d5dc7c41103 req-651f6c53-9ec3-4b36-bc57-4b67ab4622a3 tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:57:53 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07c398a-c4f8-4017-b7c3-2763d674afa2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:57:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-9273e91d-2740-4500-9b91-3d5dc7c41103 req-651f6c53-9ec3-4b36-bc57-4b67ab4622a3 tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:57:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-9273e91d-2740-4500-9b91-3d5dc7c41103 req-651f6c53-9ec3-4b36-bc57-4b67ab4622a3 tempest-AttachVolumeTestJSON-1539607517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0" returned: 0 in 0.509s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:57:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-9273e91d-2740-4500-9b91-3d5dc7c41103 req-651f6c53-9ec3-4b36-bc57-4b67ab4622a3 tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.564s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:57:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-9273e91d-2740-4500-9b91-3d5dc7c41103 req-651f6c53-9ec3-4b36-bc57-4b67ab4622a3 tempest-AttachVolumeTestJSON-1539607517 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14dad82f-e5b1-4f5e-88dc-30f171fb72b6', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 00:57:54 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-9273e91d-2740-4500-9b91-3d5dc7c41103 req-651f6c53-9ec3-4b36-bc57-4b67ab4622a3 tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:57:54 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-9273e91d-2740-4500-9b91-3d5dc7c41103 req-651f6c53-9ec3-4b36-bc57-4b67ab4622a3 tempest-AttachVolumeTestJSON-1539607517 None] attachment_update completed successfully.
Sep 18 00:57:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Acquiring lock "cinder-9e4ba799-53ca-437c-96ac-ddfdc288c345-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 00:57:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Lock "cinder-9e4ba799-53ca-437c-96ac-ddfdc288c345-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 00:57:55 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:57:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Acquiring lock "cinder-quobyte-9e4ba799-53ca-437c-96ac-ddfdc288c345" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 00:57:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Lock "cinder-quobyte-9e4ba799-53ca-437c-96ac-ddfdc288c345" acquired by "delete_volume" :: waited 0.017s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 00:57:55 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6931dfa4-9d5a-4f6c-b91e-f7b694154488]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 00:57:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9e4ba799-53ca-437c-96ac-ddfdc288c345 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:57:55 devstack quobyte-client[84147]: System call of process 88863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 00:57:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9e4ba799-53ca-437c-96ac-ddfdc288c345" returned: 0 in 0.516s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:57:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9e4ba799-53ca-437c-96ac-ddfdc288c345 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:57:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9e4ba799-53ca-437c-96ac-ddfdc288c345" returned: 0 in 0.122s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:57:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Lock "cinder-quobyte-9e4ba799-53ca-437c-96ac-ddfdc288c345" released by "delete_volume" :: held 0.802s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 00:57:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:57:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:57:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:57:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:57:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:57:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:57:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:57:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.375s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:57:56 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:57:56 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Created reservations ['a00adfb1-91a8-43a9-81e0-9b8e1bf74474', 'afb38b0c-6067-4bbe-8c5a-cf7c52671606', '3acc1850-bb50-4add-9c47-499686c0de7a', '886ffe47-f78c-4d50-9ef7-cab1f193a0a9'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 00:57:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:57:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:57:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:57:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:57:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:57:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:57:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.162s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:57:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:57:57 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Deleted volume successfully.
Sep 18 00:57:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9d9c15b1-ab48-4fd9-b831-4cb673f465f0 tempest-DeleteServersTestJSON-227710296 None] Lock "cinder-9e4ba799-53ca-437c-96ac-ddfdc288c345-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 00:58:07 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=11,cinder:SELECT=13,cinder:INSERT=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:58:07 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=12,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:58:50 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Flow 'volume_create_manager' (0378dcf9-844f-44e2-98a4-7b7cebf28923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf5d4a7-0740-43ff-a322-92c2f54ae48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf5d4a7-0740-43ff-a322-92c2f54ae48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-622590672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109e9983-7bb7-4548-9880-0ca39afb97ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd38d4c2fb0495f8e57b24ef8da61b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:58:50Z,use_quota=True,user_id='ca75955459124c96a63c34ce3cb540fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a56e43-c52c-4704-9265-90a2c13c0f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a56e43-c52c-4704-9265-90a2c13c0f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d18830-6da3-4300-8551-e3c3e896e9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d18830-6da3-4300-8551-e3c3e896e9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '109e9983-7bb7-4548-9880-0ca39afb97ed', 'volume_name': 'volume-109e9983-7bb7-4548-9880-0ca39afb97ed', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98521af-24bb-4cfb-bf9d-17644c15d4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98521af-24bb-4cfb-bf9d-17644c15d4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00283e2f-c7fd-45b0-8ea8-3aa399c6a512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:58:50 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Volume 109e9983-7bb7-4548-9880-0ca39afb97ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-109e9983-7bb7-4548-9880-0ca39afb97ed', 'volume_size': 1}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T22:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-622590672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109e9983-7bb7-4548-9880-0ca39afb97ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd38d4c2fb0495f8e57b24ef8da61b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T22:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T22:58:50Z,use_quota=True,user_id='ca75955459124c96a63c34ce3cb540fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Creating volume 109e9983-7bb7-4548-9880-0ca39afb97ed {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 00:58:50 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-109e9983-7bb7-4548-9880-0ca39afb97ed 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:58:50 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=11, name=volume-109e9983-7bb7-4548-9880-0ca39afb97ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-109e9983-7bb7-4548-9880-0ca39afb97ed 1073741824" returned: 0 in 0.357s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-109e9983-7bb7-4548-9880-0ca39afb97ed {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-109e9983-7bb7-4548-9880-0ca39afb97ed" returned: 0 in 0.085s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] <== create_volume: return (511ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.523s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00283e2f-c7fd-45b0-8ea8-3aa399c6a512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109e9983-7bb7-4548-9880-0ca39afb97ed', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e604d09-27d0-4000-87ed-2d35c158c396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 00:58:50 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Volume volume-109e9983-7bb7-4548-9880-0ca39afb97ed (109e9983-7bb7-4548-9880-0ca39afb97ed): created successfully
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e604d09-27d0-4000-87ed-2d35c158c396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 00:58:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Flow 'volume_create_manager' (0378dcf9-844f-44e2-98a4-7b7cebf28923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 00:58:51 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3898cbdc-11e8-4319-911d-96470e593939 tempest-TaggedAttachmentsTest-1066209532 None] Created volume successfully.
Sep 18 00:58:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:58:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:58:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:58:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:58:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:58:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:58:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:58:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.111s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:58:56 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:59:00 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-fc9d6652-7516-46d8-89de-09e012734707 req-4a42b32a-4db4-49e7-8313-4aba1069dc7f tempest-AttachVolumeShelveTestJSON-182342665 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:59:00 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-fc9d6652-7516-46d8-89de-09e012734707 req-4a42b32a-4db4-49e7-8313-4aba1069dc7f tempest-AttachVolumeShelveTestJSON-182342665 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:59:00 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-fc9d6652-7516-46d8-89de-09e012734707 req-4a42b32a-4db4-49e7-8313-4aba1069dc7f tempest-AttachVolumeShelveTestJSON-182342665 None] Terminate volume connection completed successfully.
Sep 18 00:59:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-fc9d6652-7516-46d8-89de-09e012734707 req-4a42b32a-4db4-49e7-8313-4aba1069dc7f tempest-AttachVolumeShelveTestJSON-182342665 None] Deleting attachment 47f9f15a-7447-4184-92ba-72edf84a274a. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 00:59:10 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:59:10 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:59:25 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 00:59:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 00:59:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 00:59:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 00:59:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 00:59:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 00:59:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 00:59:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 00:59:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.199s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 00:59:56 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 00:59:58 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-c55aec4f-60b1-48a7-abae-c3a763bb1374 req-c94ef380-2fbf-4361-9702-b5a3cad5699b tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:59:58 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-c55aec4f-60b1-48a7-abae-c3a763bb1374 req-c94ef380-2fbf-4361-9702-b5a3cad5699b tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 00:59:58 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-c55aec4f-60b1-48a7-abae-c3a763bb1374 req-c94ef380-2fbf-4361-9702-b5a3cad5699b tempest-AttachVolumeTestJSON-1539607517 None] Terminate volume connection completed successfully.
Sep 18 00:59:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-c55aec4f-60b1-48a7-abae-c3a763bb1374 req-c94ef380-2fbf-4361-9702-b5a3cad5699b tempest-AttachVolumeTestJSON-1539607517 None] Deleting attachment 14dad82f-e5b1-4f5e-88dc-30f171fb72b6. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:00:08 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:00:08 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:00:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-ac7b317e-f47e-43ca-b33d-17ab3775c10e req-38c7f8ac-e9b1-48f9-9dc0-441c22139bd9 tempest-TaggedAttachmentsTest-1066209532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:00:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-ac7b317e-f47e-43ca-b33d-17ab3775c10e req-38c7f8ac-e9b1-48f9-9dc0-441c22139bd9 tempest-TaggedAttachmentsTest-1066209532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:00:51 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d07da9-e61d-41f7-8fb1-538b6f80d8a1]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:00:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ac7b317e-f47e-43ca-b33d-17ab3775c10e req-38c7f8ac-e9b1-48f9-9dc0-441c22139bd9 tempest-TaggedAttachmentsTest-1066209532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-109e9983-7bb7-4548-9880-0ca39afb97ed {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:00:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ac7b317e-f47e-43ca-b33d-17ab3775c10e req-38c7f8ac-e9b1-48f9-9dc0-441c22139bd9 tempest-TaggedAttachmentsTest-1066209532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-109e9983-7bb7-4548-9880-0ca39afb97ed" returned: 0 in 0.830s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:00:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-ac7b317e-f47e-43ca-b33d-17ab3775c10e req-38c7f8ac-e9b1-48f9-9dc0-441c22139bd9 tempest-TaggedAttachmentsTest-1066209532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.920s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:00:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-ac7b317e-f47e-43ca-b33d-17ab3775c10e req-38c7f8ac-e9b1-48f9-9dc0-441c22139bd9 tempest-TaggedAttachmentsTest-1066209532 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-109e9983-7bb7-4548-9880-0ca39afb97ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9cf72e72-5fd7-4cf7-8fca-20e2b0d88762', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:00:52 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-ac7b317e-f47e-43ca-b33d-17ab3775c10e req-38c7f8ac-e9b1-48f9-9dc0-441c22139bd9 tempest-TaggedAttachmentsTest-1066209532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:00:52 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-ac7b317e-f47e-43ca-b33d-17ab3775c10e req-38c7f8ac-e9b1-48f9-9dc0-441c22139bd9 tempest-TaggedAttachmentsTest-1066209532 None] attachment_update completed successfully.
Sep 18 01:00:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:00:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:00:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:00:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:00:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:00:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:00:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:00:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.188s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:00:56 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:01:02 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Flow 'volume_create_manager' (4f4b9316-02c4-4eb0-b990-4ae9ab96ab08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ec1090-5765-4dac-845a-40e921644093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ec1090-5765-4dac-845a-40e921644093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-708163037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c413fa-100e-41f2-b2aa-938493157b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5dc422bae3d4b65abf84019aa11beb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:01:02Z,use_quota=True,user_id='b0adbf92feb848e58fe5dd566913ee0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1836c0-9e1e-4eb9-b2bb-74228560bd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1836c0-9e1e-4eb9-b2bb-74228560bd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5803d4b-34c7-44d0-bbb9-e3a2b94c1701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5803d4b-34c7-44d0-bbb9-e3a2b94c1701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c413fa-100e-41f2-b2aa-938493157b82', 'volume_name': 'volume-f9c413fa-100e-41f2-b2aa-938493157b82', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1199d27-9abb-4df6-a3a8-fda88f7608ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1199d27-9abb-4df6-a3a8-fda88f7608ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730a4919-4a49-4c86-bc5c-93323456c5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:01:02 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Volume f9c413fa-100e-41f2-b2aa-938493157b82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c413fa-100e-41f2-b2aa-938493157b82', 'volume_size': 1}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-708163037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c413fa-100e-41f2-b2aa-938493157b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5dc422bae3d4b65abf84019aa11beb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:01:02Z,use_quota=True,user_id='b0adbf92feb848e58fe5dd566913ee0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Creating volume f9c413fa-100e-41f2-b2aa-938493157b82 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:01:02 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f9c413fa-100e-41f2-b2aa-938493157b82 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:01:02 devstack quobyte-client[84147]: System call of process 90275 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:01:02 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=12, name=volume-f9c413fa-100e-41f2-b2aa-938493157b82, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f9c413fa-100e-41f2-b2aa-938493157b82 1073741824" returned: 0 in 0.466s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:01:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f9c413fa-100e-41f2-b2aa-938493157b82 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:01:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f9c413fa-100e-41f2-b2aa-938493157b82" returned: 0 in 0.135s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:01:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] <== create_volume: return (746ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:01:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:01:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730a4919-4a49-4c86-bc5c-93323456c5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c413fa-100e-41f2-b2aa-938493157b82', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:01:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068caa66-7933-4988-8754-c6c6199b5999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:01:03 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Volume volume-f9c413fa-100e-41f2-b2aa-938493157b82 (f9c413fa-100e-41f2-b2aa-938493157b82): created successfully
Sep 18 01:01:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068caa66-7933-4988-8754-c6c6199b5999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:01:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Flow 'volume_create_manager' (4f4b9316-02c4-4eb0-b990-4ae9ab96ab08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:01:03 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-efee2eea-88a5-4e9a-aa1f-d086c508da7c tempest-AttachVolumeShelveTestJSON-182342665 None] Created volume successfully.
Sep 18 01:01:12 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:01:13 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:01:22 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-e774dd54-141d-40ee-80ba-237f7302ed4d req-670973c7-07bd-4ac1-809b-769ddbe7fb0c tempest-AttachVolumeShelveTestJSON-182342665 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:01:23 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-e774dd54-141d-40ee-80ba-237f7302ed4d req-670973c7-07bd-4ac1-809b-769ddbe7fb0c tempest-AttachVolumeShelveTestJSON-182342665 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:01:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-e774dd54-141d-40ee-80ba-237f7302ed4d req-670973c7-07bd-4ac1-809b-769ddbe7fb0c tempest-AttachVolumeShelveTestJSON-182342665 None] No connector for attachment df939ad6-efbc-499d-9b33-54e689c09dad; skipping storage backend terminate_connection call. {{(pid=84134) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 18 01:01:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-e774dd54-141d-40ee-80ba-237f7302ed4d req-670973c7-07bd-4ac1-809b-769ddbe7fb0c tempest-AttachVolumeShelveTestJSON-182342665 None] Deleting attachment df939ad6-efbc-499d-9b33-54e689c09dad. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:01:24 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-07d71f32-116c-486c-a005-2b9ea2b4c6cd req-318144de-ff72-4317-be23-a55b6100ee5e tempest-TaggedAttachmentsTest-1066209532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:01:24 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-07d71f32-116c-486c-a005-2b9ea2b4c6cd req-318144de-ff72-4317-be23-a55b6100ee5e tempest-TaggedAttachmentsTest-1066209532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:01:24 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-07d71f32-116c-486c-a005-2b9ea2b4c6cd req-318144de-ff72-4317-be23-a55b6100ee5e tempest-TaggedAttachmentsTest-1066209532 None] Terminate volume connection completed successfully.
Sep 18 01:01:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-07d71f32-116c-486c-a005-2b9ea2b4c6cd req-318144de-ff72-4317-be23-a55b6100ee5e tempest-TaggedAttachmentsTest-1066209532 None] Deleting attachment 9cf72e72-5fd7-4cf7-8fca-20e2b0d88762. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:01:34 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=3 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:01:34 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:01:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:01:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:01:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:01:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:01:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:01:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:01:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:01:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.479s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:01:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:02:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Acquiring lock "cinder-109e9983-7bb7-4548-9880-0ca39afb97ed-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:02:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Lock "cinder-109e9983-7bb7-4548-9880-0ca39afb97ed-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:02:09 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:02:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Acquiring lock "cinder-quobyte-109e9983-7bb7-4548-9880-0ca39afb97ed" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:02:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Lock "cinder-quobyte-109e9983-7bb7-4548-9880-0ca39afb97ed" acquired by "delete_volume" :: waited 0.025s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:02:09 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[870fe30a-af7c-4751-8974-a3384a68c4ad]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:02:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-109e9983-7bb7-4548-9880-0ca39afb97ed {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:02:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-109e9983-7bb7-4548-9880-0ca39afb97ed" returned: 0 in 1.316s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:02:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-109e9983-7bb7-4548-9880-0ca39afb97ed {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:02:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-109e9983-7bb7-4548-9880-0ca39afb97ed" returned: 0 in 0.196s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:02:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Lock "cinder-quobyte-109e9983-7bb7-4548-9880-0ca39afb97ed" released by "delete_volume" :: held 1.926s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:02:11 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Created reservations ['bcfd0e54-d7c9-4442-ae44-97b122ed113f', 'e9c7d437-9e69-46d6-8111-a1bdf870894c', '0309dc36-5a86-4333-9de1-c0f853f53c87', 'd8e856d3-ffd3-4f43-b90e-72bd06b4fda4'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:02:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:02:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:02:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:02:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:02:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:02:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:02:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.240s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:02:12 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:02:12 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Deleted volume successfully.
Sep 18 01:02:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2308b56e-c737-48f8-ab6e-d5e27b06648a tempest-TaggedAttachmentsTest-1066209532 None] Lock "cinder-109e9983-7bb7-4548-9880-0ca39afb97ed-delete_volume" released by "delete_volume" :: held 4.208s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:02:22 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:02:23 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:02:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:02:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:02:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:02:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:02:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:02:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:02:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:02:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.196s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:02:56 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:03:15 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Acquiring lock "cinder-f9c413fa-100e-41f2-b2aa-938493157b82-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:03:15 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "cinder-f9c413fa-100e-41f2-b2aa-938493157b82-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:03:15 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:03:15 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Acquiring lock "cinder-quobyte-f9c413fa-100e-41f2-b2aa-938493157b82" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:03:15 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "cinder-quobyte-f9c413fa-100e-41f2-b2aa-938493157b82" acquired by "delete_volume" :: waited 0.026s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:03:15 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd8c024-9959-470e-80ef-e85af6088a01]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:03:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f9c413fa-100e-41f2-b2aa-938493157b82 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f9c413fa-100e-41f2-b2aa-938493157b82" returned: 0 in 0.471s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f9c413fa-100e-41f2-b2aa-938493157b82 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f9c413fa-100e-41f2-b2aa-938493157b82" returned: 0 in 0.124s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "cinder-quobyte-f9c413fa-100e-41f2-b2aa-938493157b82" released by "delete_volume" :: held 0.801s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:03:16 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Created reservations ['446a62ca-054f-46cf-aa9e-16f8240a84e2', '58e5c3e8-b5ef-496b-9e84-4beab4797277', 'e413e152-3b33-4a11-838b-d96254cf9d5b', '5abbb6f8-5948-4d91-9bc4-c427ddb852a8'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:03:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:03:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:03:16 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:03:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:03:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:03:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.135s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:17 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:03:17 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Deleted volume successfully.
Sep 18 01:03:17 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9f8426df-1935-4f3c-b8fc-7b938a829c6b tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "cinder-f9c413fa-100e-41f2-b2aa-938493157b82-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:03:18 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Acquiring lock "cinder-e4067346-df76-417b-be3a-621ce8a7dca6-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:03:18 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "cinder-e4067346-df76-417b-be3a-621ce8a7dca6-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:03:18 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:03:18 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Acquiring lock "cinder-quobyte-e4067346-df76-417b-be3a-621ce8a7dca6" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:03:18 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "cinder-quobyte-e4067346-df76-417b-be3a-621ce8a7dca6" acquired by "delete_volume" :: waited 0.024s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:03:18 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3ef2b8-04b9-4536-839a-b89831ca33eb]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:03:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e4067346-df76-417b-be3a-621ce8a7dca6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e4067346-df76-417b-be3a-621ce8a7dca6" returned: 0 in 0.735s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e4067346-df76-417b-be3a-621ce8a7dca6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e4067346-df76-417b-be3a-621ce8a7dca6" returned: 0 in 0.395s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "cinder-quobyte-e4067346-df76-417b-be3a-621ce8a7dca6" released by "delete_volume" :: held 1.524s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:03:20 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Created reservations ['ccc7474a-eef0-48fb-932f-da1def54e32b', '4c405c20-82b4-4fbf-9bad-6e0bc43159c5', '043c9020-914c-4a89-91c7-906d9a10aa81', '6d3bb51b-6323-48ac-8c02-f62011f38dcb'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:03:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:03:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:03:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:03:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:03:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:03:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.245s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:21 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:03:21 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Deleted volume successfully.
Sep 18 01:03:22 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f439d51-b19c-4503-a693-6965f5a66183 tempest-AttachVolumeShelveTestJSON-182342665 None] Lock "cinder-e4067346-df76-417b-be3a-621ce8a7dca6-delete_volume" released by "delete_volume" :: held 3.835s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:03:30 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=12,cinder:UPDATE=13,cinder:INSERT=4 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:03:31 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=20,cinder:SELECT=9,cinder:INSERT=4,cinder:DELETE=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:03:35 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:03:35 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:03:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Flow 'volume_create_manager' (d343ae24-6a5b-43f6-b767-7f02c95d8535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:03:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cd684c-597b-4bc8-881a-f5c2bd6f6a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cd684c-597b-4bc8-881a-f5c2bd6f6a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1888581814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9cbf3bc4394034bdc0feced0affddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:03:36Z,use_quota=True,user_id='ae06b71b2c4f41f8b3f65e091f6420f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66ad321-ed5c-4e13-8696-77af57b0a645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66ad321-ed5c-4e13-8696-77af57b0a645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fe2d36-b180-4d4b-920e-93832172dccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fe2d36-b180-4d4b-920e-93832172dccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9', 'volume_name': 'volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c52c168-89b2-4a56-b502-9f8b8b0df9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c52c168-89b2-4a56-b502-9f8b8b0df9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6dd1b54-74d5-4fe9-8348-ecf80a48ee7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:03:36 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Volume ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9', 'volume_size': 1}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1888581814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9cbf3bc4394034bdc0feced0affddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:03:36Z,use_quota=True,user_id='ae06b71b2c4f41f8b3f65e091f6420f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Creating volume ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:03:36 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:36 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=13, name=volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 1073741824" returned: 0 in 0.643s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9" returned: 0 in 0.181s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] <== create_volume: return (953ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:03:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:03:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6dd1b54-74d5-4fe9-8348-ecf80a48ee7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:03:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e138e0-cc51-4857-9121-e03912f4ab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:03:38 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Volume volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 (ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9): created successfully
Sep 18 01:03:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e138e0-cc51-4857-9121-e03912f4ab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:03:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Flow 'volume_create_manager' (d343ae24-6a5b-43f6-b767-7f02c95d8535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:03:38 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-8027cb6d-4d39-4f73-9a2f-8486c8b1bd1f req-42cefa63-a1ff-4eb4-a062-ef8053efc367 tempest-VolumesSnapshotsTestJSON-1441489811 None] Created volume successfully.
Sep 18 01:03:39 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:03:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:03:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.018s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:03:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] Creating offline snapshot 6e98d9fe-b750-4eb9-9bda-b9fa33f18074 of volume ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:03:40 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d7f1e6-d713-47b9-bf12-b1d20ad8cfe7]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:03:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:42 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:03:42 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:03:43 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Flow 'volume_create_manager' (6f0bf714-37e9-41e0-8723-fccac13cc3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:03:43 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc5abd9-16cc-4281-ad01-3bad068185fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:03:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9" returned: 0 in 3.113s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:43 devstack quobyte-client[84147]: System call of process 91154 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:03:44 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=14, name=volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:03:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc5abd9-16cc-4281-ad01-3bad068185fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1312390321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ab3ec9-8151-466d-b7d8-34193dc553ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e8e44d94d14a968dfd2173c0a5a55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:03:41Z,use_quota=True,user_id='21f18bdd55034de4963e9fc8907fd444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:03:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (086aa657-1085-4ac5-8c43-f371bedc9468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:03:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (086aa657-1085-4ac5-8c43-f371bedc9468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:03:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce61082-dc8c-4c61-a24b-af8c205ef3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:03:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce61082-dc8c-4c61-a24b-af8c205ef3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03ab3ec9-8151-466d-b7d8-34193dc553ea', 'volume_name': 'volume-03ab3ec9-8151-466d-b7d8-34193dc553ea', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:03:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec645e27-212b-4eb8-8757-bc70d8d41855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:03:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec645e27-212b-4eb8-8757-bc70d8d41855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:03:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5008c9-73ba-4590-a876-bca9d5baa77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:03:45 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Volume 03ab3ec9-8151-466d-b7d8-34193dc553ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03ab3ec9-8151-466d-b7d8-34193dc553ea', 'volume_size': 1}
Sep 18 01:03:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:03:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074 1G" returned: 0 in 2.384s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:46 devstack quobyte-client[84147]: System call of process 91166 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:03:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "qemu-img rebase -u -b volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074" returned: 0 in 0.721s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:03:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074" returned: 0 in 0.307s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:03:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074" returned: 0 in 0.447s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.info" returned: 0 in 0.312s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:03:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.info" returned: 0 in 0.310s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.822s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:03:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.548s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:03:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1312390321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ab3ec9-8151-466d-b7d8-34193dc553ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e8e44d94d14a968dfd2173c0a5a55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:03:41Z,use_quota=True,user_id='21f18bdd55034de4963e9fc8907fd444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:03:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Creating volume 03ab3ec9-8151-466d-b7d8-34193dc553ea {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:03:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:03:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:03:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:03:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:03:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:03:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:03:49 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:03:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-03ab3ec9-8151-466d-b7d8-34193dc553ea 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:49 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=16, name=volume-03ab3ec9-8151-466d-b7d8-34193dc553ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:03:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-03ab3ec9-8151-466d-b7d8-34193dc553ea 1073741824" returned: 0 in 1.791s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-03ab3ec9-8151-466d-b7d8-34193dc553ea {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:51 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-07aa4b31-2a8e-40eb-9b4d-5b2ddefd00ae req-a971ca50-71c2-4509-b201-f3a66349050f tempest-VolumesSnapshotsTestJSON-1441489811 None] Create snapshot completed successfully
Sep 18 01:03:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Acquiring lock "cinder-6e98d9fe-b750-4eb9-9bda-b9fa33f18074-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-03ab3ec9-8151-466d-b7d8-34193dc553ea" returned: 0 in 1.115s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] <== create_volume: return (2966ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.038s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "cinder-6e98d9fe-b750-4eb9-9bda-b9fa33f18074-delete_snapshot" acquired by "delete_snapshot" :: waited 0.228s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:03:52 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Acquiring lock "cinder-quobyte-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5008c9-73ba-4590-a876-bca9d5baa77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03ab3ec9-8151-466d-b7d8-34193dc553ea', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3e13db2-3b6c-488a-b77c-c8a47a9c2846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "cinder-quobyte-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9" acquired by "delete_snapshot" :: waited 0.156s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Acquiring lock "cinder-quobyte-6e98d9fe-b750-4eb9-9bda-b9fa33f18074" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "cinder-quobyte-6e98d9fe-b750-4eb9-9bda-b9fa33f18074" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Deleting offline snapshot 6e98d9fe-b750-4eb9-9bda-b9fa33f18074 of volume ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] snapshot_file for this snap is: volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:03:52 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Volume volume-03ab3ec9-8151-466d-b7d8-34193dc553ea (03ab3ec9-8151-466d-b7d8-34193dc553ea): created successfully
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3e13db2-3b6c-488a-b77c-c8a47a9c2846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Flow 'volume_create_manager' (6f0bf714-37e9-41e0-8723-fccac13cc3d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd67e45b-aa4a-483d-8707-1fd9ca5101d3]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:03:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:53 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5d9d02de-5d0b-44fc-9764-9f86d7ff555b tempest-AttachVolumeTestJSON-1539607517 None] Created volume successfully.
Sep 18 01:03:53 devstack quobyte-client[84147]: System call of process 91226 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:03:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074" returned: 0 in 0.911s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:03:53 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[088f3973-d26a-446a-8807-c801e65804ad]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:03:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9" returned: 0 in 0.770s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:54 devstack quobyte-client[84147]: System call of process 91232 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:03:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074" returned: 0 in 0.427s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9.6e98d9fe-b750-4eb9-9bda-b9fa33f18074" returned: 0 in 0.090s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "cinder-quobyte-6e98d9fe-b750-4eb9-9bda-b9fa33f18074" released by "_delete_snapshot" :: held 2.788s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:03:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "cinder-quobyte-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9" released by "delete_snapshot" :: held 2.845s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:03:55 devstack cinder-volume[84134]: WARNING cinder.quota [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:03:55 devstack cinder-volume[84134]: DEBUG cinder.quota [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Created reservations ['c287e2e3-d898-4b27-b7d7-b79e992ebe81', 'f245fef4-df03-40d5-b573-e29de852c571', '411ae40c-06af-43ba-9b12-7c4c7383d35f', '2e783c02-30aa-47cc-8d45-fa0ff0bbd3d3'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:03:55 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Delete snapshot completed successfully.
Sep 18 01:03:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-160590ce-a607-471e-88eb-8604f9186fee req-fce20308-33f2-4726-8501-e3fac6c0cb7e tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "cinder-6e98d9fe-b750-4eb9-9bda-b9fa33f18074-delete_snapshot" released by "delete_snapshot" :: held 3.754s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:03:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:03:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:03:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:03:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:03:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:03:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:03:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.234s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:03:56 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:03:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Acquiring lock "cinder-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:03:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "cinder-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9-delete_volume" acquired by "delete_volume" :: waited 0.164s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:03:58 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:03:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Acquiring lock "cinder-quobyte-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:03:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-fa74af3f-99c7-4b4b-87cf-a9fe0f23c9ae req-01d9c680-eecc-4ad7-9a2e-13e1e5ec3088 tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:03:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-fa74af3f-99c7-4b4b-87cf-a9fe0f23c9ae req-01d9c680-eecc-4ad7-9a2e-13e1e5ec3088 tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:03:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "cinder-quobyte-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9" acquired by "delete_volume" :: waited 0.095s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:03:58 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e6bed7-6174-4582-9fd5-7ecc6217fd18]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:03:58 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d984c04-ba67-4cb6-b05b-319566433334]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:03:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-fa74af3f-99c7-4b4b-87cf-a9fe0f23c9ae req-01d9c680-eecc-4ad7-9a2e-13e1e5ec3088 tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-03ab3ec9-8151-466d-b7d8-34193dc553ea {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:03:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-fa74af3f-99c7-4b4b-87cf-a9fe0f23c9ae req-01d9c680-eecc-4ad7-9a2e-13e1e5ec3088 tempest-AttachVolumeTestJSON-1539607517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-03ab3ec9-8151-466d-b7d8-34193dc553ea" returned: 0 in 1.662s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-fa74af3f-99c7-4b4b-87cf-a9fe0f23c9ae req-01d9c680-eecc-4ad7-9a2e-13e1e5ec3088 tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:04:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9" returned: 0 in 2.969s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9" returned: 0 in 0.872s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-fa74af3f-99c7-4b4b-87cf-a9fe0f23c9ae req-01d9c680-eecc-4ad7-9a2e-13e1e5ec3088 tempest-AttachVolumeTestJSON-1539607517 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-03ab3ec9-8151-466d-b7d8-34193dc553ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e42ab2c-59a7-4e73-9c01-27e5205c0c17', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:04:02 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-fa74af3f-99c7-4b4b-87cf-a9fe0f23c9ae req-01d9c680-eecc-4ad7-9a2e-13e1e5ec3088 tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:04:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "cinder-quobyte-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9" released by "delete_volume" :: held 4.207s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:04:03 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-fa74af3f-99c7-4b4b-87cf-a9fe0f23c9ae req-01d9c680-eecc-4ad7-9a2e-13e1e5ec3088 tempest-AttachVolumeTestJSON-1539607517 None] attachment_update completed successfully.
Sep 18 01:04:03 devstack cinder-volume[84134]: DEBUG cinder.quota [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Created reservations ['c82dc4e0-f384-42d3-99ea-833b319f3e8d', 'aa915122-2ceb-4710-b617-3adbaf1be4ec', 'f3124705-6620-4ce5-8c4d-77e54e6071f8', '06e922df-3a7e-475a-8185-e8d5f6063860'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:04:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:04:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:04:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:04:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:04:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:04:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.122s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:03 devstack cinder-volume[84134]: DEBUG cinder.manager [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:04:03 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Deleted volume successfully.
Sep 18 01:04:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-2727fb04-ba0f-40ab-ae31-74aff933df32 req-9689f4c4-fcb5-4195-8295-62cf3f6177d4 tempest-VolumesSnapshotsTestJSON-1441489811 None] Lock "cinder-ca6aa4e0-4fa6-49c3-a2ed-bbe36264a8c9-delete_volume" released by "delete_volume" :: held 6.534s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:04:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ebcb31da-53df-48b6-ade7-a4b5bfcaf0f4 tempest-BackendsCapabilitiesAdminTestsJSON-70039541 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84134) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 18 01:04:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-74aac216-3784-4fcd-975e-a80be86e6cd6 tempest-BackendsCapabilitiesAdminTestsJSON-70039541 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84134) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 18 01:04:13 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=20,cinder:DELETE=2,cinder:SELECT=17 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:04:13 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:04:13 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:04:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Flow 'volume_create_manager' (437c7aff-4642-4d0e-848b-866b946c047e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:04:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b7ec3d-4200-4f3e-ac5e-840f11107b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b7ec3d-4200-4f3e-ac5e-840f11107b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1063932966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8632dd-49dc-4316-95ea-6bb76c034b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e8e44d94d14a968dfd2173c0a5a55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:04:14Z,use_quota=True,user_id='21f18bdd55034de4963e9fc8907fd444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab42187-0181-4307-9b0b-51a78bab74df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab42187-0181-4307-9b0b-51a78bab74df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e14664-6209-48fb-8c24-b53da94ec94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e14664-6209-48fb-8c24-b53da94ec94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f8632dd-49dc-4316-95ea-6bb76c034b22', 'volume_name': 'volume-4f8632dd-49dc-4316-95ea-6bb76c034b22', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382f7dc1-01cc-4889-aef3-4ff50d8b7487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382f7dc1-01cc-4889-aef3-4ff50d8b7487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d6a865-b86e-4a21-b617-8273d2f42466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:14 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Volume 4f8632dd-49dc-4316-95ea-6bb76c034b22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f8632dd-49dc-4316-95ea-6bb76c034b22', 'volume_size': 1}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1063932966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8632dd-49dc-4316-95ea-6bb76c034b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e8e44d94d14a968dfd2173c0a5a55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:04:14Z,use_quota=True,user_id='21f18bdd55034de4963e9fc8907fd444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Creating volume 4f8632dd-49dc-4316-95ea-6bb76c034b22 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:04:14 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4f8632dd-49dc-4316-95ea-6bb76c034b22 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:14 devstack quobyte-client[84147]: System call of process 91748 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:04:14 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=17, name=volume-4f8632dd-49dc-4316-95ea-6bb76c034b22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4f8632dd-49dc-4316-95ea-6bb76c034b22 1073741824" returned: 0 in 0.393s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4f8632dd-49dc-4316-95ea-6bb76c034b22 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4f8632dd-49dc-4316-95ea-6bb76c034b22" returned: 0 in 0.187s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] <== create_volume: return (664ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:04:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:04:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d6a865-b86e-4a21-b617-8273d2f42466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8632dd-49dc-4316-95ea-6bb76c034b22', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2a0bff-cdf9-4fca-a7b7-747b07f80c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:15 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Volume volume-4f8632dd-49dc-4316-95ea-6bb76c034b22 (4f8632dd-49dc-4316-95ea-6bb76c034b22): created successfully
Sep 18 01:04:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2a0bff-cdf9-4fca-a7b7-747b07f80c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Flow 'volume_create_manager' (437c7aff-4642-4d0e-848b-866b946c047e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:04:15 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-bb9119bd-041c-43bc-b62b-1880abf360fc tempest-AttachVolumeTestJSON-1539607517 None] Created volume successfully.
Sep 18 01:04:18 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-a3376a03-6d57-4bd7-a0ef-aea3bb52bca1 tempest-GroupsV320Test-2055326140 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:04:18 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-a3376a03-6d57-4bd7-a0ef-aea3bb52bca1 tempest-GroupsV320Test-2055326140 None] Group tempest-GroupsV320Test-Group-780930533: creating
Sep 18 01:04:18 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-a3376a03-6d57-4bd7-a0ef-aea3bb52bca1 tempest-GroupsV320Test-2055326140 None] Group tempest-GroupsV320Test-Group-780930533: created successfully
Sep 18 01:04:19 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-a3376a03-6d57-4bd7-a0ef-aea3bb52bca1 tempest-GroupsV320Test-2055326140 None] Create group completed successfully.
Sep 18 01:04:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2b63d09f-ce66-4177-8253-72f58ded80a4 req-6656e47d-7310-44a4-86a8-1eac6707d4de tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:04:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2b63d09f-ce66-4177-8253-72f58ded80a4 req-6656e47d-7310-44a4-86a8-1eac6707d4de tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:04:20 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3af9d7-2084-4e50-b472-d6f948948ed0]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:04:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2b63d09f-ce66-4177-8253-72f58ded80a4 req-6656e47d-7310-44a4-86a8-1eac6707d4de tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4f8632dd-49dc-4316-95ea-6bb76c034b22 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2b63d09f-ce66-4177-8253-72f58ded80a4 req-6656e47d-7310-44a4-86a8-1eac6707d4de tempest-AttachVolumeTestJSON-1539607517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4f8632dd-49dc-4316-95ea-6bb76c034b22" returned: 0 in 0.913s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2b63d09f-ce66-4177-8253-72f58ded80a4 req-6656e47d-7310-44a4-86a8-1eac6707d4de tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.963s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:04:20 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Flow 'volume_create_manager' (6d6370b5-c60a-4e33-89bd-5983a1bd83a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b215d6-2fd3-4c04-a7ac-a58f5db29fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b215d6-2fd3-4c04-a7ac-a58f5db29fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-794739165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e90a192-6220-4461-90aa-2e21bf705836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e235f90c45460cb853d06d8c0038cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:04:21Z,use_quota=True,user_id='d6b4e9672fc44654a617c286447f6936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af9f293-86db-4b43-ac3d-032dae85c0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af9f293-86db-4b43-ac3d-032dae85c0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3dbe70-55ba-4491-9e5f-f0e3d9cf1af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3dbe70-55ba-4491-9e5f-f0e3d9cf1af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e90a192-6220-4461-90aa-2e21bf705836', 'volume_name': 'volume-3e90a192-6220-4461-90aa-2e21bf705836', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c9ad3d-eb77-4c26-8744-5775907c4cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c9ad3d-eb77-4c26-8744-5775907c4cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3727fdd1-8423-46eb-8e15-d5d7b19138a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:21 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Volume 3e90a192-6220-4461-90aa-2e21bf705836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e90a192-6220-4461-90aa-2e21bf705836', 'volume_size': 1}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-794739165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e90a192-6220-4461-90aa-2e21bf705836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e235f90c45460cb853d06d8c0038cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:04:21Z,use_quota=True,user_id='d6b4e9672fc44654a617c286447f6936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Creating volume 3e90a192-6220-4461-90aa-2e21bf705836 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:04:21 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e90a192-6220-4461-90aa-2e21bf705836 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:21 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=18, name=volume-3e90a192-6220-4461-90aa-2e21bf705836, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:04:21 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-c24feae5-542b-404e-ab69-a08078a94b5b tempest-GroupsV320Test-2055326140 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e90a192-6220-4461-90aa-2e21bf705836 1073741824" returned: 0 in 0.674s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e90a192-6220-4461-90aa-2e21bf705836 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2b63d09f-ce66-4177-8253-72f58ded80a4 req-6656e47d-7310-44a4-86a8-1eac6707d4de tempest-AttachVolumeTestJSON-1539607517 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-4f8632dd-49dc-4316-95ea-6bb76c034b22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85fc589f-08e5-4d77-a0da-0972b3d2607b', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:04:22 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-2b63d09f-ce66-4177-8253-72f58ded80a4 req-6656e47d-7310-44a4-86a8-1eac6707d4de tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e90a192-6220-4461-90aa-2e21bf705836" returned: 0 in 0.362s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] <== create_volume: return (1130ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3727fdd1-8423-46eb-8e15-d5d7b19138a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e90a192-6220-4461-90aa-2e21bf705836', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a28fa8-1754-4d46-959f-eecb8624fdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-c24feae5-542b-404e-ab69-a08078a94b5b tempest-GroupsV320Test-2055326140 None] Created reservations ['48e41e3e-a7b8-42ff-9703-20486d66ad17'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:04:22 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Volume volume-3e90a192-6220-4461-90aa-2e21bf705836 (3e90a192-6220-4461-90aa-2e21bf705836): created successfully
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a28fa8-1754-4d46-959f-eecb8624fdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Flow 'volume_create_manager' (6d6370b5-c60a-4e33-89bd-5983a1bd83a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:04:22 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-2b63d09f-ce66-4177-8253-72f58ded80a4 req-6656e47d-7310-44a4-86a8-1eac6707d4de tempest-AttachVolumeTestJSON-1539607517 None] attachment_update completed successfully.
Sep 18 01:04:22 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-0058fca7-a706-45f2-a026-ad0796a0e443 tempest-ServersNegativeTestJSON-651156073 None] Created volume successfully.
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c24feae5-542b-404e-ab69-a08078a94b5b tempest-GroupsV320Test-2055326140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c24feae5-542b-404e-ab69-a08078a94b5b tempest-GroupsV320Test-2055326140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c24feae5-542b-404e-ab69-a08078a94b5b tempest-GroupsV320Test-2055326140 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c24feae5-542b-404e-ab69-a08078a94b5b tempest-GroupsV320Test-2055326140 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c24feae5-542b-404e-ab69-a08078a94b5b tempest-GroupsV320Test-2055326140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c24feae5-542b-404e-ab69-a08078a94b5b tempest-GroupsV320Test-2055326140 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c24feae5-542b-404e-ab69-a08078a94b5b tempest-GroupsV320Test-2055326140 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.110s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:22 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-c24feae5-542b-404e-ab69-a08078a94b5b tempest-GroupsV320Test-2055326140 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:04:22 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-c24feae5-542b-404e-ab69-a08078a94b5b tempest-GroupsV320Test-2055326140 None] Delete group completed successfully.
Sep 18 01:04:25 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Flow 'volume_create_manager' (ae44310a-d45d-4a26-912b-864f18e68b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ffc887f-ca36-467c-8c8b-21ea37d3c670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ffc887f-ca36-467c-8c8b-21ea37d3c670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1598322706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54312ce-b3c5-4f98-b00c-9861054c37fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e235f90c45460cb853d06d8c0038cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:04:25Z,use_quota=True,user_id='d6b4e9672fc44654a617c286447f6936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45a880f-7cf5-49e6-930c-e32f72bdd6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45a880f-7cf5-49e6-930c-e32f72bdd6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24be6c16-f3fd-4a98-9245-d0a8e3144367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24be6c16-f3fd-4a98-9245-d0a8e3144367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a54312ce-b3c5-4f98-b00c-9861054c37fe', 'volume_name': 'volume-a54312ce-b3c5-4f98-b00c-9861054c37fe', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291dba6a-a515-498a-b5a6-cf5f908bf86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291dba6a-a515-498a-b5a6-cf5f908bf86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734d9c56-c849-47c7-8250-858f1a7e179d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:25 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Volume a54312ce-b3c5-4f98-b00c-9861054c37fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a54312ce-b3c5-4f98-b00c-9861054c37fe', 'volume_size': 1}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1598322706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54312ce-b3c5-4f98-b00c-9861054c37fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e235f90c45460cb853d06d8c0038cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:04:25Z,use_quota=True,user_id='d6b4e9672fc44654a617c286447f6936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Creating volume a54312ce-b3c5-4f98-b00c-9861054c37fe {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:04:25 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:04:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a54312ce-b3c5-4f98-b00c-9861054c37fe 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:26 devstack quobyte-client[84147]: System call of process 91817 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:04:26 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=19, name=volume-a54312ce-b3c5-4f98-b00c-9861054c37fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:04:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a54312ce-b3c5-4f98-b00c-9861054c37fe 1073741824" returned: 0 in 0.510s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a54312ce-b3c5-4f98-b00c-9861054c37fe {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a54312ce-b3c5-4f98-b00c-9861054c37fe" returned: 0 in 0.196s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:26 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] <== create_volume: return (874ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:04:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:04:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734d9c56-c849-47c7-8250-858f1a7e179d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a54312ce-b3c5-4f98-b00c-9861054c37fe', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d6515c-4595-4e32-9e0d-f3523b91dfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:04:27 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Volume volume-a54312ce-b3c5-4f98-b00c-9861054c37fe (a54312ce-b3c5-4f98-b00c-9861054c37fe): created successfully
Sep 18 01:04:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d6515c-4595-4e32-9e0d-f3523b91dfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:04:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Flow 'volume_create_manager' (ae44310a-d45d-4a26-912b-864f18e68b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:04:27 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-403c38ff-1eb8-4656-9c85-db02c452d4dd tempest-ServersNegativeTestJSON-651156073 None] Created volume successfully.
Sep 18 01:04:28 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Acquiring lock "cinder-a54312ce-b3c5-4f98-b00c-9861054c37fe-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:04:28 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Lock "cinder-a54312ce-b3c5-4f98-b00c-9861054c37fe-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:04:28 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:04:28 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Acquiring lock "cinder-quobyte-a54312ce-b3c5-4f98-b00c-9861054c37fe" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:04:28 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Lock "cinder-quobyte-a54312ce-b3c5-4f98-b00c-9861054c37fe" acquired by "delete_volume" :: waited 0.016s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:04:28 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[660379ea-62d1-409c-af84-16fecee75c0a]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:04:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a54312ce-b3c5-4f98-b00c-9861054c37fe {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a54312ce-b3c5-4f98-b00c-9861054c37fe" returned: 0 in 0.772s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a54312ce-b3c5-4f98-b00c-9861054c37fe {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a54312ce-b3c5-4f98-b00c-9861054c37fe" returned: 0 in 0.326s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:30 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Lock "cinder-quobyte-a54312ce-b3c5-4f98-b00c-9861054c37fe" released by "delete_volume" :: held 1.349s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:04:30 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Created reservations ['993e97a1-c1a5-48dd-b9fe-f09d8c1504b6', '4f98859b-786a-46e6-83cc-e14627d2ce78', '182cb399-2ac5-4e22-9477-30cafd5715e8', '4256e63f-5483-4aaa-a2d9-6a9b77894236'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:04:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:04:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:04:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:04:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:04:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:04:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.192s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:31 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:04:31 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Deleted volume successfully.
Sep 18 01:04:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Acquiring lock "cinder-3e90a192-6220-4461-90aa-2e21bf705836-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:04:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-652ac134-3ba3-4de1-ab85-ac85cbe8a1aa tempest-ServersNegativeTestJSON-651156073 None] Lock "cinder-a54312ce-b3c5-4f98-b00c-9861054c37fe-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:04:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Lock "cinder-3e90a192-6220-4461-90aa-2e21bf705836-delete_volume" acquired by "delete_volume" :: waited 0.194s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:04:32 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:04:32 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Acquiring lock "cinder-quobyte-3e90a192-6220-4461-90aa-2e21bf705836" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:04:32 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Lock "cinder-quobyte-3e90a192-6220-4461-90aa-2e21bf705836" acquired by "delete_volume" :: waited 0.021s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:04:32 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[39507b6b-8c79-45c3-836a-e9c9b92881d2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:04:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e90a192-6220-4461-90aa-2e21bf705836 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:32 devstack quobyte-client[84147]: System call of process 91838 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:04:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e90a192-6220-4461-90aa-2e21bf705836" returned: 0 in 0.798s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e90a192-6220-4461-90aa-2e21bf705836 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e90a192-6220-4461-90aa-2e21bf705836" returned: 0 in 0.143s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:33 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Lock "cinder-quobyte-3e90a192-6220-4461-90aa-2e21bf705836" released by "delete_volume" :: held 1.284s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:04:33 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=42,cinder:UPDATE=39,cinder:DELETE=3,cinder:INSERT=10 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:04:33 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Created reservations ['67214ec3-5ef7-47c0-8fec-a98b8b3bfded', 'ef399265-1e6b-472b-b286-ac6d1761869a', '37c15e2f-a775-415b-9929-c23ce2eb01e4', '63524605-2ea7-4743-8405-af274d1cc88a'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:04:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:04:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:04:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:04:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:04:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:04:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.181s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:34 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:04:34 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Deleted volume successfully.
Sep 18 01:04:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-41b412ad-ab54-47ea-ac1a-31fc04413c3b tempest-ServersNegativeTestJSON-651156073 None] Lock "cinder-3e90a192-6220-4461-90aa-2e21bf705836-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:04:44 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=27,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=7 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:04:44 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:04:52 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-ba1eee12-6788-4138-9935-b027fd305463 req-142df4d9-18da-4e19-8cea-be63ef16108c tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:04:52 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-ba1eee12-6788-4138-9935-b027fd305463 req-142df4d9-18da-4e19-8cea-be63ef16108c tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:04:52 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-ba1eee12-6788-4138-9935-b027fd305463 req-142df4d9-18da-4e19-8cea-be63ef16108c tempest-AttachVolumeTestJSON-1539607517 None] Terminate volume connection completed successfully.
Sep 18 01:04:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-ba1eee12-6788-4138-9935-b027fd305463 req-142df4d9-18da-4e19-8cea-be63ef16108c tempest-AttachVolumeTestJSON-1539607517 None] Deleting attachment 0e42ab2c-59a7-4e73-9c01-27e5205c0c17. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:04:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:04:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:04:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:04:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:04:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:04:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:04:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:04:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.254s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:04:56 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:05:01 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Flow 'volume_create_manager' (89cfb4aa-4370-4abc-818b-85f97a32481c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05c17a1-8560-4cf0-91e1-68f45b68f6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05c17a1-8560-4cf0-91e1-68f45b68f6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2144606510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80debd11128492ba42d0e551cec5781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:05:02Z,use_quota=True,user_id='0c434706921b43648e545c449e84a4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5a2614-484c-4b48-8197-73d8d22e309e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5a2614-484c-4b48-8197-73d8d22e309e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0ca3fe-ad5f-4f98-8869-bd938085c691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0ca3fe-ad5f-4f98-8869-bd938085c691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b', 'volume_name': 'volume-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8219ccae-df91-43d9-824e-c19311b2870a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8219ccae-df91-43d9-824e-c19311b2870a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4405f8f-adfd-4520-a4dd-25c4e1eec822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:01 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Volume f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b', 'volume_size': 1}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2144606510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80debd11128492ba42d0e551cec5781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:05:02Z,use_quota=True,user_id='0c434706921b43648e545c449e84a4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Creating volume f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:05:01 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:05:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:02 devstack quobyte-client[84147]: System call of process 91972 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:05:02 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=20, name=volume-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:05:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b 1073741824" returned: 0 in 0.350s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b" returned: 0 in 0.085s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] <== create_volume: return (546ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:05:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.580s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:05:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4405f8f-adfd-4520-a4dd-25c4e1eec822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd7d9d4-ac73-46f2-9c08-62af5f462d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:02 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Volume volume-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b (f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b): created successfully
Sep 18 01:05:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd7d9d4-ac73-46f2-9c08-62af5f462d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Flow 'volume_create_manager' (89cfb4aa-4370-4abc-818b-85f97a32481c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:05:02 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-df060243-b540-4020-9a30-55b92d3d66ae tempest-VolumeQuotasAdminTestJSON-1944906146 None] Created volume successfully.
Sep 18 01:05:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Acquiring lock "cinder-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Lock "cinder-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:04 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:05:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Acquiring lock "cinder-quobyte-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Lock "cinder-quobyte-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b" acquired by "delete_volume" :: waited 0.017s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:04 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa18a930-e7a5-48b5-bf20-06f6d605905c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:05:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b" returned: 0 in 0.667s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b" returned: 0 in 0.098s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Lock "cinder-quobyte-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b" released by "delete_volume" :: held 0.969s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:05 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Created reservations ['4fd95e61-400a-4133-8c52-9106fd88de6e', '876490ec-990b-40c3-be5c-b6f24e865f53', 'ffd479da-d719-4cf9-b758-f155e629ee0e', '88bb3311-079f-4560-973b-221b10befa2d'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:05:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:05:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:05:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:05:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:05:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:05:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.124s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:06 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:05:06 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Deleted volume successfully.
Sep 18 01:05:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-358b50b5-48f0-4569-b463-94fbcb604d69 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Lock "cinder-f40f2ef2-c9c8-4e2f-b517-4a9aa03b870b-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:07 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Flow 'volume_create_manager' (758b7da7-5569-4328-9eb5-2f8b0a7740e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec22de4-6fed-44c7-bd0d-b1f112f2d9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec22de4-6fed-44c7-bd0d-b1f112f2d9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1740104468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6448659-4b16-40ce-a913-483dc852d961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80debd11128492ba42d0e551cec5781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:05:07Z,use_quota=True,user_id='0c434706921b43648e545c449e84a4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce60626-7aef-4810-bd58-bc31d8f33610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce60626-7aef-4810-bd58-bc31d8f33610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54880c2-a589-4c7c-99e2-10ce3502c133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54880c2-a589-4c7c-99e2-10ce3502c133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6448659-4b16-40ce-a913-483dc852d961', 'volume_name': 'volume-f6448659-4b16-40ce-a913-483dc852d961', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c3d543-337c-444c-b118-432707c120d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c3d543-337c-444c-b118-432707c120d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179162a3-449e-495f-906b-7a6318157c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:07 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Volume f6448659-4b16-40ce-a913-483dc852d961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6448659-4b16-40ce-a913-483dc852d961', 'volume_size': 1}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1740104468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6448659-4b16-40ce-a913-483dc852d961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80debd11128492ba42d0e551cec5781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:05:07Z,use_quota=True,user_id='0c434706921b43648e545c449e84a4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Creating volume f6448659-4b16-40ce-a913-483dc852d961 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:05:07 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f6448659-4b16-40ce-a913-483dc852d961 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:07 devstack quobyte-client[84147]: System call of process 91984 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:05:07 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=21, name=volume-f6448659-4b16-40ce-a913-483dc852d961, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f6448659-4b16-40ce-a913-483dc852d961 1073741824" returned: 0 in 0.324s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f6448659-4b16-40ce-a913-483dc852d961 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f6448659-4b16-40ce-a913-483dc852d961" returned: 0 in 0.124s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:08 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] <== create_volume: return (518ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:05:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.531s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:05:08 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179162a3-449e-495f-906b-7a6318157c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6448659-4b16-40ce-a913-483dc852d961', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:08 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a7fbf1-ca26-4358-9998-3338925da9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:08 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Volume volume-f6448659-4b16-40ce-a913-483dc852d961 (f6448659-4b16-40ce-a913-483dc852d961): created successfully
Sep 18 01:05:08 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a7fbf1-ca26-4358-9998-3338925da9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:08 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Flow 'volume_create_manager' (758b7da7-5569-4328-9eb5-2f8b0a7740e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:05:08 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-55d79802-8417-4bcd-9bc4-c7439c331078 tempest-VolumeQuotasAdminTestJSON-1944906146 None] Created volume successfully.
Sep 18 01:05:09 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-7fa15865-abe8-4d92-8134-46a7ec982430 tempest-VolumeQuotasAdminTestJSON-1687602545 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:05:09 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-7fa15865-abe8-4d92-8134-46a7ec982430 tempest-VolumeQuotasAdminTestJSON-1687602545 None] Transfer volume completed successfully.
Sep 18 01:05:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Acquiring lock "cinder-f6448659-4b16-40ce-a913-483dc852d961-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Lock "cinder-f6448659-4b16-40ce-a913-483dc852d961-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:11 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:05:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Acquiring lock "cinder-quobyte-f6448659-4b16-40ce-a913-483dc852d961" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Lock "cinder-quobyte-f6448659-4b16-40ce-a913-483dc852d961" acquired by "delete_volume" :: waited 0.012s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:11 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2e3d21-15cb-48fc-b0f2-4ab0f1a22ab2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:05:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f6448659-4b16-40ce-a913-483dc852d961 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f6448659-4b16-40ce-a913-483dc852d961" returned: 0 in 0.412s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f6448659-4b16-40ce-a913-483dc852d961 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f6448659-4b16-40ce-a913-483dc852d961" returned: 0 in 0.095s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Lock "cinder-quobyte-f6448659-4b16-40ce-a913-483dc852d961" released by "delete_volume" :: held 0.679s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:12 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Created reservations ['1cdf1ab9-a0d3-463c-9c82-4994b683a9bf', 'fb8109ce-a478-40d7-8051-99ade7033983', '4911d5e6-20db-4c2c-a12c-f012a4607791', 'c8f1f6dc-5cc0-461c-8ff7-f1959fe20450'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:05:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:05:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:05:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:05:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:05:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:05:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.153s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:12 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:05:12 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Deleted volume successfully.
Sep 18 01:05:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7618a54e-2ec6-4ac0-8313-48c5e2378b5b tempest-VolumeQuotasAdminTestJSON-2014752303 None] Lock "cinder-f6448659-4b16-40ce-a913-483dc852d961-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:17 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-a5e1344b-a51c-4117-95f7-0ac21caccb4d req-c32c46b1-3e8f-4299-b1dc-d567278bcd13 tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:05:17 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-a5e1344b-a51c-4117-95f7-0ac21caccb4d req-c32c46b1-3e8f-4299-b1dc-d567278bcd13 tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:05:17 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-a5e1344b-a51c-4117-95f7-0ac21caccb4d req-c32c46b1-3e8f-4299-b1dc-d567278bcd13 tempest-AttachVolumeTestJSON-1539607517 None] Terminate volume connection completed successfully.
Sep 18 01:05:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-a5e1344b-a51c-4117-95f7-0ac21caccb4d req-c32c46b1-3e8f-4299-b1dc-d567278bcd13 tempest-AttachVolumeTestJSON-1539607517 None] Deleting attachment 85fc589f-08e5-4d77-a0da-0972b3d2607b. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:05:23 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:05:23 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:05:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Flow 'volume_create_manager' (4a5c6726-bc94-495a-a827-f2c4168486cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:05:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da5a7b8-cc39-4332-a3c0-ce4c3f8d6c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da5a7b8-cc39-4332-a3c0-ce4c3f8d6c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1276052415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fffc047-eef8-4600-bdaf-233240816968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83eb327735424aa89ba4f7f7ad1222e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:05:24Z,use_quota=True,user_id='3aecf7fa896c4ac58c43ac0794e278d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e050d1-0e60-4a0a-a5fb-b461044a4226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e050d1-0e60-4a0a-a5fb-b461044a4226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63c2912-79ff-41d0-b2bf-c90fe031c1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63c2912-79ff-41d0-b2bf-c90fe031c1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fffc047-eef8-4600-bdaf-233240816968', 'volume_name': 'volume-1fffc047-eef8-4600-bdaf-233240816968', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b91711-5dbb-4f7b-8fd1-c0c32ca81eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b91711-5dbb-4f7b-8fd1-c0c32ca81eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e2d13a-2084-4b0a-9784-c75e4ca50443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:24 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Volume 1fffc047-eef8-4600-bdaf-233240816968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fffc047-eef8-4600-bdaf-233240816968', 'volume_size': 1}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1276052415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fffc047-eef8-4600-bdaf-233240816968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83eb327735424aa89ba4f7f7ad1222e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:05:24Z,use_quota=True,user_id='3aecf7fa896c4ac58c43ac0794e278d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Creating volume 1fffc047-eef8-4600-bdaf-233240816968 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:05:24 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:24 devstack quobyte-client[84147]: System call of process 92061 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:05:24 devstack quobyte-client[84147]: System call of process 92061 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:05:24 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=22, name=volume-1fffc047-eef8-4600-bdaf-233240816968, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968 1073741824" returned: 0 in 0.468s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968" returned: 0 in 0.317s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] <== create_volume: return (927ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:05:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:05:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e2d13a-2084-4b0a-9784-c75e4ca50443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fffc047-eef8-4600-bdaf-233240816968', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5761fa6-c6e8-4b79-b1cb-b242b4b4f497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:05:25 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Volume volume-1fffc047-eef8-4600-bdaf-233240816968 (1fffc047-eef8-4600-bdaf-233240816968): created successfully
Sep 18 01:05:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5761fa6-c6e8-4b79-b1cb-b242b4b4f497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:05:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Flow 'volume_create_manager' (4a5c6726-bc94-495a-a827-f2c4168486cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:05:25 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5ee794d0-e79a-4643-8715-e5e969cb5a29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Created volume successfully.
Sep 18 01:05:26 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:05:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:05:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:05:26 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Creating offline snapshot 253c45d7-3a8e-43a2-8dc8-817840032f87 of volume 1fffc047-eef8-4600-bdaf-233240816968 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:05:26 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[38376bfb-ddef-4445-b46d-9bbb9f70918a]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:05:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968" returned: 0 in 0.566s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:27 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=23, name=volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:05:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87 1G" returned: 0 in 0.276s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1fffc047-eef8-4600-bdaf-233240816968 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "qemu-img rebase -u -b volume-1fffc047-eef8-4600-bdaf-233240816968 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87" returned: 0 in 0.295s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:05:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87" returned: 0 in 0.143s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:05:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87" returned: 0 in 0.131s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.info" returned: 0 in 0.111s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:05:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.info" returned: 0 in 0.092s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:05:28 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8920d0f9-308b-4032-aba0-43c52dee6f97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Create snapshot completed successfully
Sep 18 01:05:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Acquiring lock "cinder-253c45d7-3a8e-43a2-8dc8-817840032f87-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "cinder-253c45d7-3a8e-43a2-8dc8-817840032f87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.115s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:31 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:05:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Acquiring lock "cinder-quobyte-1fffc047-eef8-4600-bdaf-233240816968" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "cinder-quobyte-1fffc047-eef8-4600-bdaf-233240816968" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Acquiring lock "cinder-quobyte-253c45d7-3a8e-43a2-8dc8-817840032f87" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "cinder-quobyte-253c45d7-3a8e-43a2-8dc8-817840032f87" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Deleting offline snapshot 253c45d7-3a8e-43a2-8dc8-817840032f87 of volume 1fffc047-eef8-4600-bdaf-233240816968 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:05:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] snapshot_file for this snap is: volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:05:31 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a958fc6-dc32-404f-b3cb-f2dba81de836]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:05:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:32 devstack quobyte-client[84147]: System call of process 92146 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:05:32 devstack quobyte-client[84147]: System call of process 92146 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:05:32 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "cinder-4f8632dd-49dc-4316-95ea-6bb76c034b22-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87" returned: 0 in 1.271s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:32 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Lock "cinder-4f8632dd-49dc-4316-95ea-6bb76c034b22-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fffc047-eef8-4600-bdaf-233240816968(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:05:33 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e39d6e-47cb-4618-a118-c6e0b6fc0edf]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:05:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:33 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:05:33 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "cinder-quobyte-4f8632dd-49dc-4316-95ea-6bb76c034b22" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Lock "cinder-quobyte-4f8632dd-49dc-4316-95ea-6bb76c034b22" acquired by "delete_volume" :: waited 0.122s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:34 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[be155612-63c0-460e-b78e-fa8638af7870]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:05:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4f8632dd-49dc-4316-95ea-6bb76c034b22 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968" returned: 0 in 1.099s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:34 devstack quobyte-client[84147]: System call of process 92163 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:05:34 devstack quobyte-client[84147]: System call of process 92160 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:05:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87" returned: 0 in 0.661s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4f8632dd-49dc-4316-95ea-6bb76c034b22" returned: 0 in 1.098s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4f8632dd-49dc-4316-95ea-6bb76c034b22 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968.253c45d7-3a8e-43a2-8dc8-817840032f87" returned: 0 in 0.236s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4f8632dd-49dc-4316-95ea-6bb76c034b22" returned: 0 in 0.176s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:35 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "cinder-quobyte-253c45d7-3a8e-43a2-8dc8-817840032f87" released by "_delete_snapshot" :: held 3.947s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:35 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Lock "cinder-quobyte-4f8632dd-49dc-4316-95ea-6bb76c034b22" released by "delete_volume" :: held 1.461s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:35 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "cinder-quobyte-1fffc047-eef8-4600-bdaf-233240816968" released by "delete_snapshot" :: held 4.119s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:35 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Created reservations ['15ecff79-f7ce-437e-a9e9-1607f190540f', '359632cd-525c-4918-b95c-6e5e5f93b5be', 'b17e7f48-e92e-46c4-9b9d-d614bcbc7a78', 'b2e21da5-2971-4d9d-b424-513dffe840b0'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:05:35 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Created reservations ['d66491ed-ee79-4382-9314-f14430c6d5ab', '769c3459-b565-484c-9ea7-c7d06016c3ea', '190230a1-9b15-4137-bee8-50bdc03a0511', 'e93caaff-6cd1-4d42-a252-d63b2900ea60'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:05:36 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Delete snapshot completed successfully.
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f57a7ad-3b39-4029-aec8-4b2fc581de39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "cinder-253c45d7-3a8e-43a2-8dc8-817840032f87-delete_snapshot" released by "delete_snapshot" :: held 4.518s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.105s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:05:36 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Deleted volume successfully.
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "cinder-03ab3ec9-8151-466d-b7d8-34193dc553ea-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Lock "cinder-03ab3ec9-8151-466d-b7d8-34193dc553ea-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-816da4e2-b5d9-4b51-a616-f5d23d0153d2 tempest-AttachVolumeTestJSON-1539607517 None] Lock "cinder-4f8632dd-49dc-4316-95ea-6bb76c034b22-delete_volume" released by "delete_volume" :: held 3.768s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:36 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "cinder-quobyte-03ab3ec9-8151-466d-b7d8-34193dc553ea" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Lock "cinder-quobyte-03ab3ec9-8151-466d-b7d8-34193dc553ea" acquired by "delete_volume" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a477b0-392e-4b7e-a840-fed2decb4f9a]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:05:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-03ab3ec9-8151-466d-b7d8-34193dc553ea {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:37 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Acquiring lock "cinder-1fffc047-eef8-4600-bdaf-233240816968-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:37 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "cinder-1fffc047-eef8-4600-bdaf-233240816968-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-03ab3ec9-8151-466d-b7d8-34193dc553ea" returned: 0 in 0.679s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-03ab3ec9-8151-466d-b7d8-34193dc553ea {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-03ab3ec9-8151-466d-b7d8-34193dc553ea" returned: 0 in 0.369s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:37 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:05:37 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Acquiring lock "cinder-quobyte-1fffc047-eef8-4600-bdaf-233240816968" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:38 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Lock "cinder-quobyte-03ab3ec9-8151-466d-b7d8-34193dc553ea" released by "delete_volume" :: held 1.208s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:38 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "cinder-quobyte-1fffc047-eef8-4600-bdaf-233240816968" acquired by "delete_volume" :: waited 0.050s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:38 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b063ae-f8f6-4c24-b1bc-c2a9a5dbf8a8]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:05:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:38 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Created reservations ['9833cd09-8e8c-4116-99c0-e08ae1e6c415', 'c463280a-bc6f-4d8d-a987-6c2cfa1af59c', 'b57a9fcc-e449-4d87-8f52-896e6d0d9f2e', '9b87e72f-a813-4a42-bfdc-9b60d1c15b3d'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:05:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968" returned: 0 in 0.696s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1fffc047-eef8-4600-bdaf-233240816968" returned: 0 in 0.246s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:39 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "cinder-quobyte-1fffc047-eef8-4600-bdaf-233240816968" released by "delete_volume" :: held 1.118s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:05:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:05:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:05:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:05:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:05:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:39 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Created reservations ['e98c51fd-ef84-4c0a-b243-b1fbccaa5c7c', 'f3ad56c4-1408-4876-b14d-51be4ac92217', 'f0cf2e8c-3544-47ee-baf0-b778b9632859', '952b77dd-c23e-4bd1-91d1-5884538809eb'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:05:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.377s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:39 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:05:39 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Deleted volume successfully.
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5806cf0a-53f1-488d-8840-745b14fc16b9 tempest-AttachVolumeTestJSON-1539607517 None] Lock "cinder-03ab3ec9-8151-466d-b7d8-34193dc553ea-delete_volume" released by "delete_volume" :: held 3.375s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "cinder-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Lock "cinder-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.695s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:05:40 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Deleted volume successfully.
Sep 18 01:05:40 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "cinder-quobyte-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6fc3f945-fefd-438f-a921-57cc76e40860 tempest-VolumeSnapshotQuotasNegativeTestJSON-1188007540 None] Lock "cinder-1fffc047-eef8-4600-bdaf-233240816968-delete_volume" released by "delete_volume" :: held 3.550s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Lock "cinder-quobyte-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0" acquired by "delete_volume" :: waited 0.027s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aec82d-7d05-44f2-9e80-19fcfaf95bb2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:05:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0" returned: 0 in 1.061s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0" returned: 0 in 0.287s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Lock "cinder-quobyte-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0" released by "delete_volume" :: held 1.926s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:43 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Created reservations ['7003da79-4d54-4740-8642-fc06f0c4a7cb', 'e907bc2b-c07e-4388-83c0-6eb794bdb5ca', 'd1b0b397-6ba3-4496-9fff-19f460a04e9f', '5332b64a-38e4-42d5-bebe-c3a2d87a4ae5'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:05:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:05:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:05:44 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:05:44 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:05:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:05:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.134s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:44 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:05:44 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Deleted volume successfully.
Sep 18 01:05:45 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=37,cinder:UPDATE=59,cinder:DELETE=7,cinder:INSERT=13 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:05:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fadaa7ce-5497-46cc-ad80-b5e6c1259cd0 tempest-AttachVolumeTestJSON-1539607517 None] Lock "cinder-9ad610d3-4fb1-4e18-9b01-b2d37f5007f0-delete_volume" released by "delete_volume" :: held 4.927s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:05:54 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=47,cinder:UPDATE=63,cinder:INSERT=15,cinder:DELETE=3 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:05:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:05:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:05:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:05:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:05:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:05:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:05:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:05:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.291s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:05:56 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:06:01 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Flow 'volume_create_manager' (dfd5b61a-d1ca-48e0-9ab7-d93fbbb51830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c7772b-3984-4a23-bbfb-53d3c1128445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c7772b-3984-4a23-bbfb-53d3c1128445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1504587008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0c1645-809c-4216-b86e-191de3806aa9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0eca8e1ba904a0dac58fc54fcce88b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:06:01Z,use_quota=True,user_id='4718a906133a4abf8eddee963d30ded7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2e94d9-d8c8-4b38-a173-5ef37fe466be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2e94d9-d8c8-4b38-a173-5ef37fe466be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c457f4-39e1-416a-a7c9-f1ad8ce67fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c457f4-39e1-416a-a7c9-f1ad8ce67fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0c1645-809c-4216-b86e-191de3806aa9', 'volume_name': 'volume-4b0c1645-809c-4216-b86e-191de3806aa9', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ded5bff-408c-4a8d-8c28-bbd09ea51461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ded5bff-408c-4a8d-8c28-bbd09ea51461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9d83b0-3eeb-4f16-baa5-66d5a9a5f97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:01 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Volume 4b0c1645-809c-4216-b86e-191de3806aa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0c1645-809c-4216-b86e-191de3806aa9', 'volume_size': 1}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1504587008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0c1645-809c-4216-b86e-191de3806aa9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0eca8e1ba904a0dac58fc54fcce88b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:06:01Z,use_quota=True,user_id='4718a906133a4abf8eddee963d30ded7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Creating volume 4b0c1645-809c-4216-b86e-191de3806aa9 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:06:01 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:06:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b0c1645-809c-4216-b86e-191de3806aa9 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:02 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=25, name=volume-4b0c1645-809c-4216-b86e-191de3806aa9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:06:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b0c1645-809c-4216-b86e-191de3806aa9 1073741824" returned: 0 in 0.610s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b0c1645-809c-4216-b86e-191de3806aa9 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b0c1645-809c-4216-b86e-191de3806aa9" returned: 0 in 0.184s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] <== create_volume: return (959ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:06:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9d83b0-3eeb-4f16-baa5-66d5a9a5f97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0c1645-809c-4216-b86e-191de3806aa9', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c50ca32-7017-4996-b669-0e5fd280bdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:03 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Volume volume-4b0c1645-809c-4216-b86e-191de3806aa9 (4b0c1645-809c-4216-b86e-191de3806aa9): created successfully
Sep 18 01:06:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c50ca32-7017-4996-b669-0e5fd280bdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Flow 'volume_create_manager' (dfd5b61a-d1ca-48e0-9ab7-d93fbbb51830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:06:03 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-2696b5fd-2d75-4980-9e41-8ad1d4469f20 req-79c77c70-7b7a-49fd-a1ad-77f2f036d19b tempest-VolumesGetTestJSON-810713830 None] Created volume successfully.
Sep 18 01:06:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Acquiring lock "cinder-4b0c1645-809c-4216-b86e-191de3806aa9-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:06:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Lock "cinder-4b0c1645-809c-4216-b86e-191de3806aa9-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:06:04 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:06:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Acquiring lock "cinder-quobyte-4b0c1645-809c-4216-b86e-191de3806aa9" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:06:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Lock "cinder-quobyte-4b0c1645-809c-4216-b86e-191de3806aa9" acquired by "delete_volume" :: waited 0.015s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:06:04 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9ce5bc-438d-4eb3-8844-280f8b9cc589]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:06:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b0c1645-809c-4216-b86e-191de3806aa9 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b0c1645-809c-4216-b86e-191de3806aa9" returned: 0 in 0.594s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b0c1645-809c-4216-b86e-191de3806aa9 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b0c1645-809c-4216-b86e-191de3806aa9" returned: 0 in 0.121s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Lock "cinder-quobyte-4b0c1645-809c-4216-b86e-191de3806aa9" released by "delete_volume" :: held 1.014s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:06:05 devstack cinder-volume[84134]: DEBUG cinder.quota [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Created reservations ['39ab566a-8685-40a7-ba12-0e42795f8432', '2235049b-3c97-4703-8dc1-87b70c9170d0', 'ff02d222-cdaf-4e7b-b5e5-c8905e67dc6d', 'b1ff78e0-f7a0-4a93-bf80-111d1ca1c356'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:06:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:06:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:06:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.161s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:06 devstack cinder-volume[84134]: DEBUG cinder.manager [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:06:06 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Deleted volume successfully.
Sep 18 01:06:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-ccde9488-b3cd-492d-86e6-27910426121a req-1de44bac-7ad7-4988-8945-07fa3d8761c1 tempest-VolumesGetTestJSON-810713830 None] Lock "cinder-4b0c1645-809c-4216-b86e-191de3806aa9-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:06:11 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Flow 'volume_create_manager' (d6deb132-f832-4458-bd45-7887d3da9ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ecaaf2-323d-4085-ae77-49b9397e1562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ecaaf2-323d-4085-ae77-49b9397e1562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-198904915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527a2d85-26ac-4284-8d04-b8b07d3d4619,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88b836b266be4f75bc44ccd57b59f49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:06:11Z,use_quota=True,user_id='bea0df2cefc1400da2a513c3bcb1d130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6cbde88-51a9-4c7c-93e1-9ef2e69ea08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6cbde88-51a9-4c7c-93e1-9ef2e69ea08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af17eb01-5ea8-42c0-a07b-ae8f14d52ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af17eb01-5ea8-42c0-a07b-ae8f14d52ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '527a2d85-26ac-4284-8d04-b8b07d3d4619', 'volume_name': 'volume-527a2d85-26ac-4284-8d04-b8b07d3d4619', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facbe5b8-a3ac-4b13-ac78-287f8f9147eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facbe5b8-a3ac-4b13-ac78-287f8f9147eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c3c3ad-0c1c-4fec-a2d5-f59985958800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:11 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Volume 527a2d85-26ac-4284-8d04-b8b07d3d4619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-527a2d85-26ac-4284-8d04-b8b07d3d4619', 'volume_size': 1}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-198904915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527a2d85-26ac-4284-8d04-b8b07d3d4619,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88b836b266be4f75bc44ccd57b59f49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:06:11Z,use_quota=True,user_id='bea0df2cefc1400da2a513c3bcb1d130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Creating volume 527a2d85-26ac-4284-8d04-b8b07d3d4619 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:06:11 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:06:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-527a2d85-26ac-4284-8d04-b8b07d3d4619 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:11 devstack quobyte-client[84147]: System call of process 92269 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:06:11 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=26, name=volume-527a2d85-26ac-4284-8d04-b8b07d3d4619, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:06:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-527a2d85-26ac-4284-8d04-b8b07d3d4619 1073741824" returned: 0 in 0.476s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-527a2d85-26ac-4284-8d04-b8b07d3d4619 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-527a2d85-26ac-4284-8d04-b8b07d3d4619" returned: 0 in 0.206s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] <== create_volume: return (937ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:06:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c3c3ad-0c1c-4fec-a2d5-f59985958800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-527a2d85-26ac-4284-8d04-b8b07d3d4619', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9b16df-00d2-4718-a3a3-667dcdb28688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:12 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Volume volume-527a2d85-26ac-4284-8d04-b8b07d3d4619 (527a2d85-26ac-4284-8d04-b8b07d3d4619): created successfully
Sep 18 01:06:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9b16df-00d2-4718-a3a3-667dcdb28688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Flow 'volume_create_manager' (d6deb132-f832-4458-bd45-7887d3da9ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:06:13 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-bee3e7ca-85e4-4bfb-b85a-2ad2575f0348 tempest-VolumesTestJSON-1024029506 None] Created volume successfully.
Sep 18 01:06:14 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Flow 'volume_create_manager' (8e953280-02d8-4b08-8f8c-77e7ec008313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4442d10b-47de-4cae-9c04-9fbabf1d1eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4442d10b-47de-4cae-9c04-9fbabf1d1eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2142599244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46f4e82-d676-40aa-ae56-fff891c8d942,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88b836b266be4f75bc44ccd57b59f49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:06:14Z,use_quota=True,user_id='bea0df2cefc1400da2a513c3bcb1d130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632a5b5a-7fb0-43cc-aee5-1070963de4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632a5b5a-7fb0-43cc-aee5-1070963de4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b341fd-6631-446c-9c6f-236c29cb0592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b341fd-6631-446c-9c6f-236c29cb0592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b46f4e82-d676-40aa-ae56-fff891c8d942', 'volume_name': 'volume-b46f4e82-d676-40aa-ae56-fff891c8d942', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4077a99-f150-4bbb-8ed3-efc0d4e9ee7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4077a99-f150-4bbb-8ed3-efc0d4e9ee7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1831a8af-2cd8-4e5f-b8c9-c77648622175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:14 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Volume b46f4e82-d676-40aa-ae56-fff891c8d942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b46f4e82-d676-40aa-ae56-fff891c8d942', 'volume_size': 1}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2142599244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46f4e82-d676-40aa-ae56-fff891c8d942,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88b836b266be4f75bc44ccd57b59f49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:06:14Z,use_quota=True,user_id='bea0df2cefc1400da2a513c3bcb1d130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Creating volume b46f4e82-d676-40aa-ae56-fff891c8d942 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:06:14 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b46f4e82-d676-40aa-ae56-fff891c8d942 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:14 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=27, name=volume-b46f4e82-d676-40aa-ae56-fff891c8d942, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b46f4e82-d676-40aa-ae56-fff891c8d942 1073741824" returned: 0 in 0.397s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b46f4e82-d676-40aa-ae56-fff891c8d942 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b46f4e82-d676-40aa-ae56-fff891c8d942" returned: 0 in 0.155s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] <== create_volume: return (636ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:06:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.650s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1831a8af-2cd8-4e5f-b8c9-c77648622175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b46f4e82-d676-40aa-ae56-fff891c8d942', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397b120b-7550-4484-8ff1-84c39ea5424d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:15 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Volume volume-b46f4e82-d676-40aa-ae56-fff891c8d942 (b46f4e82-d676-40aa-ae56-fff891c8d942): created successfully
Sep 18 01:06:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397b120b-7550-4484-8ff1-84c39ea5424d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Flow 'volume_create_manager' (8e953280-02d8-4b08-8f8c-77e7ec008313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:06:15 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-58fc0e3a-2ac4-4add-a739-6ebdb17ff114 tempest-VolumesTestJSON-1024029506 None] Created volume successfully.
Sep 18 01:06:17 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Flow 'volume_create_manager' (a7ec3e4d-7a99-4179-b2fe-786dc160a87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1024eff8-cd88-4881-9acd-056555583aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1024eff8-cd88-4881-9acd-056555583aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1532363782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a199037b-add3-4447-86ab-0d0c1a517e7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88b836b266be4f75bc44ccd57b59f49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:06:17Z,use_quota=True,user_id='bea0df2cefc1400da2a513c3bcb1d130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc00cf37-5c04-4e46-82e6-7c283defdf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc00cf37-5c04-4e46-82e6-7c283defdf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1e376b-ec83-4d5e-812e-80123f8af236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1e376b-ec83-4d5e-812e-80123f8af236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a199037b-add3-4447-86ab-0d0c1a517e7e', 'volume_name': 'volume-a199037b-add3-4447-86ab-0d0c1a517e7e', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24273a05-273a-43fe-865d-8f2ced8e2525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24273a05-273a-43fe-865d-8f2ced8e2525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1f1e2a-41c5-4f11-a430-5604a3993f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:17 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Volume a199037b-add3-4447-86ab-0d0c1a517e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a199037b-add3-4447-86ab-0d0c1a517e7e', 'volume_size': 1}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1532363782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a199037b-add3-4447-86ab-0d0c1a517e7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88b836b266be4f75bc44ccd57b59f49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:06:17Z,use_quota=True,user_id='bea0df2cefc1400da2a513c3bcb1d130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Creating volume a199037b-add3-4447-86ab-0d0c1a517e7e {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:06:17 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a199037b-add3-4447-86ab-0d0c1a517e7e 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:17 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=28, name=volume-a199037b-add3-4447-86ab-0d0c1a517e7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a199037b-add3-4447-86ab-0d0c1a517e7e 1073741824" returned: 0 in 0.486s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a199037b-add3-4447-86ab-0d0c1a517e7e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a199037b-add3-4447-86ab-0d0c1a517e7e" returned: 0 in 0.170s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] <== create_volume: return (767ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:06:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:18 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1f1e2a-41c5-4f11-a430-5604a3993f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a199037b-add3-4447-86ab-0d0c1a517e7e', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:18 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9645d446-d4cf-4a7e-b01c-9097e5be7392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:18 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Volume volume-a199037b-add3-4447-86ab-0d0c1a517e7e (a199037b-add3-4447-86ab-0d0c1a517e7e): created successfully
Sep 18 01:06:18 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9645d446-d4cf-4a7e-b01c-9097e5be7392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:18 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Flow 'volume_create_manager' (a7ec3e4d-7a99-4179-b2fe-786dc160a87e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:06:18 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-da265559-bd95-433c-abf4-72b6cd6afb79 tempest-VolumesTestJSON-1024029506 None] Created volume successfully.
Sep 18 01:06:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Acquiring lock "cinder-a199037b-add3-4447-86ab-0d0c1a517e7e-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:06:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Lock "cinder-a199037b-add3-4447-86ab-0d0c1a517e7e-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:06:20 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:06:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Acquiring lock "cinder-quobyte-a199037b-add3-4447-86ab-0d0c1a517e7e" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:06:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Lock "cinder-quobyte-a199037b-add3-4447-86ab-0d0c1a517e7e" acquired by "delete_volume" :: waited 0.009s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:06:20 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[95425a9b-7a41-4fef-9f11-feab9f1d1183]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:06:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a199037b-add3-4447-86ab-0d0c1a517e7e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a199037b-add3-4447-86ab-0d0c1a517e7e" returned: 0 in 0.508s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a199037b-add3-4447-86ab-0d0c1a517e7e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a199037b-add3-4447-86ab-0d0c1a517e7e" returned: 0 in 0.107s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:21 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Lock "cinder-quobyte-a199037b-add3-4447-86ab-0d0c1a517e7e" released by "delete_volume" :: held 0.780s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:06:21 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Created reservations ['a0093e4d-3fa7-4e0c-b2cc-4f69ce50ed71', '76241a97-a080-42f6-81e3-c77bdd5c1c49', '92de3fbb-e5ae-462a-b976-bc62a31ac1ab', '316f0d3f-fc34-4ea2-8ba7-3ad4b4f6b82d'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:06:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:06:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:06:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.120s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:21 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:06:21 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Deleted volume successfully.
Sep 18 01:06:22 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f9b09a31-ddfb-406d-bfb9-797b9b087195 tempest-VolumesTestJSON-1024029506 None] Lock "cinder-a199037b-add3-4447-86ab-0d0c1a517e7e-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:06:22 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Acquiring lock "cinder-b46f4e82-d676-40aa-ae56-fff891c8d942-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:06:22 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Lock "cinder-b46f4e82-d676-40aa-ae56-fff891c8d942-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:06:22 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:06:22 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Acquiring lock "cinder-quobyte-b46f4e82-d676-40aa-ae56-fff891c8d942" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:06:22 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Lock "cinder-quobyte-b46f4e82-d676-40aa-ae56-fff891c8d942" acquired by "delete_volume" :: waited 0.014s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:06:22 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1573750c-59d7-4400-aa3e-bf36a26f4f0d]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:06:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b46f4e82-d676-40aa-ae56-fff891c8d942 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b46f4e82-d676-40aa-ae56-fff891c8d942" returned: 0 in 0.473s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b46f4e82-d676-40aa-ae56-fff891c8d942 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b46f4e82-d676-40aa-ae56-fff891c8d942" returned: 0 in 0.127s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:23 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Lock "cinder-quobyte-b46f4e82-d676-40aa-ae56-fff891c8d942" released by "delete_volume" :: held 0.849s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:06:24 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Created reservations ['ad81cf13-c52e-4014-9768-0f5c4da7f0e9', '324f42ee-e828-44ec-8445-097240972460', 'b749a3c1-a745-4e36-a2a0-e0f6de90831d', '3f581a90-e5fb-4462-95ae-b49bda1987bd'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:06:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:06:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:06:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.175s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:24 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:06:25 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Deleted volume successfully.
Sep 18 01:06:25 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Acquiring lock "cinder-527a2d85-26ac-4284-8d04-b8b07d3d4619-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:06:25 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-de577ad8-eea2-412f-bdae-eec8629ca33f tempest-VolumesTestJSON-1024029506 None] Lock "cinder-b46f4e82-d676-40aa-ae56-fff891c8d942-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:06:25 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Lock "cinder-527a2d85-26ac-4284-8d04-b8b07d3d4619-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:06:25 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:06:25 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Acquiring lock "cinder-quobyte-527a2d85-26ac-4284-8d04-b8b07d3d4619" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:06:25 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Lock "cinder-quobyte-527a2d85-26ac-4284-8d04-b8b07d3d4619" acquired by "delete_volume" :: waited 0.024s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:06:25 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a6428f-abe0-4e5e-8432-d244b6b417fe]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:06:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-527a2d85-26ac-4284-8d04-b8b07d3d4619 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:26 devstack quobyte-client[84147]: System call of process 92298 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:06:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-527a2d85-26ac-4284-8d04-b8b07d3d4619" returned: 0 in 0.604s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-527a2d85-26ac-4284-8d04-b8b07d3d4619 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-527a2d85-26ac-4284-8d04-b8b07d3d4619" returned: 0 in 0.113s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:26 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Lock "cinder-quobyte-527a2d85-26ac-4284-8d04-b8b07d3d4619" released by "delete_volume" :: held 0.984s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:06:26 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Created reservations ['9e238ee2-5830-4fe4-aced-7469fac05278', '6b364a78-05a5-480b-bdbc-388f3fff6297', 'd33c2a9f-7620-41c8-841d-99138a39e0bf', 'e19dc2dd-49b4-480e-b1b8-a7dee3ff6ed6'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:06:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:06:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:06:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.090s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:27 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:06:27 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Deleted volume successfully.
Sep 18 01:06:27 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b97fb49a-2a66-419e-afe9-3a66501c5cb6 tempest-VolumesTestJSON-1024029506 None] Lock "cinder-527a2d85-26ac-4284-8d04-b8b07d3d4619-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:06:36 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-9596a7e2-ba1b-4a85-a594-2ab2741c7c34 tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:06:36 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-9596a7e2-ba1b-4a85-a594-2ab2741c7c34 tempest-GroupSnapshotsTest-1402530406 None] Group tempest-GroupSnapshotsTest-Group-1556699938: creating
Sep 18 01:06:36 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-9596a7e2-ba1b-4a85-a594-2ab2741c7c34 tempest-GroupSnapshotsTest-1402530406 None] Group tempest-GroupSnapshotsTest-Group-1556699938: created successfully
Sep 18 01:06:36 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-9596a7e2-ba1b-4a85-a594-2ab2741c7c34 tempest-GroupSnapshotsTest-1402530406 None] Create group completed successfully.
Sep 18 01:06:38 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Flow 'volume_create_manager' (54cca985-4e20-4009-b88f-b5025a2c07d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3df6e57-92d5-4ba3-a01d-51435050b739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3df6e57-92d5-4ba3-a01d-51435050b739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1433580437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bfac2b10-582e-4473-9155-6c3ba89a0ece,host='devstack@QuobyteHD#QuobyteHD',id=c75ac204-1c8f-48c5-8f5e-7f84ecedde39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844926cd9d8545eb9738543420ec7e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:06:38Z,use_quota=True,user_id='48397779f47b4547ae3bcef0a0637f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d44e375-ba0a-44aa-a9a9-f7e1fe9ca8cb),volume_type_id=5d44e375-ba0a-44aa-a9a9-f7e1fe9ca8cb)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e7c4bc-6988-4cd7-bb68-6d7793a44194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e7c4bc-6988-4cd7-bb68-6d7793a44194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a7947d-63fa-43a4-bfa8-ee7fb28bfbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a7947d-63fa-43a4-bfa8-ee7fb28bfbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c75ac204-1c8f-48c5-8f5e-7f84ecedde39', 'volume_name': 'volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28782ba2-6dff-477f-a9b2-917791f05710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28782ba2-6dff-477f-a9b2-917791f05710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d2cc4a-2c67-4859-b8df-1f513e49d9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:38 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Volume c75ac204-1c8f-48c5-8f5e-7f84ecedde39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39', 'volume_size': 1}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bfac2b10-582e-4473-9155-6c3ba89a0ece,created_at=2025-09-17T23:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1433580437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bfac2b10-582e-4473-9155-6c3ba89a0ece,host='devstack@QuobyteHD#QuobyteHD',id=c75ac204-1c8f-48c5-8f5e-7f84ecedde39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844926cd9d8545eb9738543420ec7e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:06:38Z,use_quota=True,user_id='48397779f47b4547ae3bcef0a0637f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d44e375-ba0a-44aa-a9a9-f7e1fe9ca8cb),volume_type_id=5d44e375-ba0a-44aa-a9a9-f7e1fe9ca8cb)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Creating volume c75ac204-1c8f-48c5-8f5e-7f84ecedde39 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:06:38 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:06:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:38 devstack quobyte-client[84147]: System call of process 92336 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:06:38 devstack quobyte-client[84147]: System call of process 92336 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:06:38 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=29, name=volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:06:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 1073741824" returned: 0 in 0.482s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39" returned: 0 in 0.120s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] <== create_volume: return (694ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:06:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d2cc4a-2c67-4859-b8df-1f513e49d9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e935dc-40bd-49cd-a0e5-633ebc081712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:39 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Volume volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 (c75ac204-1c8f-48c5-8f5e-7f84ecedde39): created successfully
Sep 18 01:06:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e935dc-40bd-49cd-a0e5-633ebc081712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Flow 'volume_create_manager' (54cca985-4e20-4009-b88f-b5025a2c07d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:06:39 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5460990c-a60f-4baa-ac25-14176013ce53 tempest-GroupSnapshotsTest-1402530406 None] Created volume successfully.
Sep 18 01:06:40 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] GroupSnapshot 0aad6a09-7597-4e85-bbff-38b1d648f4fc: creating.
Sep 18 01:06:41 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:06:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] Group snapshot 0aad6a09-7597-4e85-bbff-38b1d648f4fc: creating. {{(pid=84134) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 01:06:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] Creating offline snapshot 42d9ae6e-feb4-4aff-aa59-a347602de921 of volume c75ac204-1c8f-48c5-8f5e-7f84ecedde39 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:06:41 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea0d930-2247-4cc4-8f66-26573481338f]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:06:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39" returned: 0 in 0.507s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:41 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=30, name=volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:06:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921 1G" returned: 0 in 0.219s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img rebase -u -b volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921" returned: 0 in 0.148s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:06:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921" returned: 0 in 0.160s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:06:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921" returned: 0 in 0.247s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.info" returned: 0 in 0.208s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:43 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:06:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.info" returned: 0 in 0.186s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:43 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-c985e204-3f72-418d-94da-8737fa7d027f tempest-GroupSnapshotsTest-1402530406 None] group_snapshot 0aad6a09-7597-4e85-bbff-38b1d648f4fc: created successfully
Sep 18 01:06:47 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-42d9ae6e-feb4-4aff-aa59-a347602de921-f631466d-c1c6-4f0e-b424-c064300850ae" by "_create_volume_from_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-42d9ae6e-feb4-4aff-aa59-a347602de921-f631466d-c1c6-4f0e-b424-c064300850ae" acquired by "_create_volume_from_snapshot" :: waited 0.061s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Creating volume f631466d-c1c6-4f0e-b424-c064300850ae from snapshot 42d9ae6e-feb4-4aff-aa59-a347602de921 {{(pid=84134) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-f631466d-c1c6-4f0e-b424-c064300850ae" by "_copy_volume_from_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-f631466d-c1c6-4f0e-b424-c064300850ae" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] snapshot: 42d9ae6e-feb4-4aff-aa59-a347602de921, volume: f631466d-c1c6-4f0e-b424-c064300850ae,  {{(pid=84134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[862e74d7-1e3e-4a8d-87dc-47bdd99ec511]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:06:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:48 devstack quobyte-client[84147]: System call of process 92422 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:06:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921" returned: 0 in 1.190s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:06:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] will copy from snapshot at /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 {{(pid=84134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 01:06:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Creating direct copy from snapshot {{(pid=84134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 01:06:49 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2685043-073f-43fc-9307-89a9df09b010]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:06:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:50 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:06:50 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:06:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Flow 'volume_create_manager' (2887b470-171e-43d0-8513-ba8616fb2ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:06:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1087b600-8013-458f-98d9-112a0591b262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1087b600-8013-458f-98d9-112a0591b262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-608807189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7f1747-f745-4da8-81a6-e57b00bba1e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6920fc1d0554b32beb791855050a1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:06:49Z,use_quota=True,user_id='432d409366d04016a55c80563699e1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb243d92-4ab7-4fc6-bd2a-dfdbf62d6e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb243d92-4ab7-4fc6-bd2a-dfdbf62d6e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7400e5d-1c99-4cf6-b2a6-d983bb7b0b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7400e5d-1c99-4cf6-b2a6-d983bb7b0b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7f1747-f745-4da8-81a6-e57b00bba1e2', 'volume_name': 'volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df96a820-70f3-44b1-9daf-2c30d12ead28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df96a820-70f3-44b1-9daf-2c30d12ead28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:06:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94a376c-93e9-4d52-a216-7d2345224c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:06:51 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Volume bf7f1747-f745-4da8-81a6-e57b00bba1e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2', 'volume_size': 1}
Sep 18 01:06:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39" returned: 0 in 1.862s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:51 devstack cinder-volume[84134]: DEBUG cinder.utils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f631466d-c1c6-4f0e-b424-c064300850ae not found in is_blk_device check {{(pid=84134) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 01:06:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f631466d-c1c6-4f0e-b424-c064300850ae {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:51 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=32, name=volume-f631466d-c1c6-4f0e-b424-c064300850ae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:06:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:06:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:06:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.036s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:06:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:06:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:06:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.082s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:06:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:06:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.850s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:06:58 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:07:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f631466d-c1c6-4f0e-b424-c064300850ae" returned: 0 in 8.941s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:00 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[05146bbb-e1c4-4285-aae3-813f6a938c98]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:00 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=35,cinder:UPDATE=49,cinder:DELETE=4,cinder:INSERT=10 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:07:00 devstack quobyte-client[84147]: System call of process 92514 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:07:01 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=41,cinder:SELECT=35,cinder:DELETE=5,cinder:INSERT=6 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:07:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39" returned: 0 in 1.064s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:01 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Image conversion details: src /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39, size 1024.00 MB, duration 8.99 sec, destination /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f631466d-c1c6-4f0e-b424-c064300850ae {{(pid=84134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 01:07:01 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Converted 1024.00 MB image at 113.95 MB/s
Sep 18 01:07:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f631466d-c1c6-4f0e-b424-c064300850ae is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:07:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f631466d-c1c6-4f0e-b424-c064300850ae {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:01 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:01 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:07:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Flow 'volume_create_manager' (bdc5cd2e-18fe-4191-b2bb-c93deaa11864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dab71b4-a39d-4039-9c52-89b38b90a2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dab71b4-a39d-4039-9c52-89b38b90a2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-487296458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab297ae-9efd-4f6e-ae99-244539f9f022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c4b34bb7a4888a6449fa1babffe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:07:01Z,use_quota=True,user_id='ddfc4ea998b94c9aadad1c3c5ac8874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e705924e-b656-4c3e-9cd5-8a8cfae726a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e705924e-b656-4c3e-9cd5-8a8cfae726a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1b07ad-e541-4ea0-bade-000198166b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1b07ad-e541-4ea0-bade-000198166b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab297ae-9efd-4f6e-ae99-244539f9f022', 'volume_name': 'volume-1ab297ae-9efd-4f6e-ae99-244539f9f022', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cbd1da-28e1-4b5e-9cac-66127855a6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cbd1da-28e1-4b5e-9cac-66127855a6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025fb5be-e6a4-49e4-b287-f5c380e186fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:02 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Volume 1ab297ae-9efd-4f6e-ae99-244539f9f022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab297ae-9efd-4f6e-ae99-244539f9f022', 'volume_size': 1}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f631466d-c1c6-4f0e-b424-c064300850ae" returned: 0 in 0.647s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-f631466d-c1c6-4f0e-b424-c064300850ae" released by "_copy_volume_from_snapshot" :: held 14.511s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-42d9ae6e-feb4-4aff-aa59-a347602de921-f631466d-c1c6-4f0e-b424-c064300850ae" released by "_create_volume_from_snapshot" :: held 14.576s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.661s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.949s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-608807189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7f1747-f745-4da8-81a6-e57b00bba1e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6920fc1d0554b32beb791855050a1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:06:49Z,use_quota=True,user_id='432d409366d04016a55c80563699e1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Creating volume bf7f1747-f745-4da8-81a6-e57b00bba1e2 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:07:02 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:02 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=33, name=volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2 1073741824" returned: 0 in 0.656s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2" returned: 0 in 0.380s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] <== create_volume: return (1097ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.301s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-487296458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab297ae-9efd-4f6e-ae99-244539f9f022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c4b34bb7a4888a6449fa1babffe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:07:01Z,use_quota=True,user_id='ddfc4ea998b94c9aadad1c3c5ac8874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Creating volume 1ab297ae-9efd-4f6e-ae99-244539f9f022 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:07:03 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1ab297ae-9efd-4f6e-ae99-244539f9f022 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:03 devstack quobyte-client[84147]: System call of process 92525 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:07:03 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=34, name=volume-1ab297ae-9efd-4f6e-ae99-244539f9f022, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94a376c-93e9-4d52-a216-7d2345224c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf2555e-cd8b-4911-b56e-806b195079b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:03 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Volume volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2 (bf7f1747-f745-4da8-81a6-e57b00bba1e2): created successfully
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf2555e-cd8b-4911-b56e-806b195079b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Flow 'volume_create_manager' (2887b470-171e-43d0-8513-ba8616fb2ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:04 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-d82cf403-7437-4b94-986b-0b2da94d90f3 tempest-AttachVolumeNegativeTest-1787668276 None] Created volume successfully.
Sep 18 01:07:04 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-f6b67e32-2f4c-4fa9-8ce3-e2b1a068e16e tempest-GroupSnapshotsTest-1402530406 None] Create group from source-snapshot-0aad6a09-7597-4e85-bbff-38b1d648f4fc completed successfully.
Sep 18 01:07:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1ab297ae-9efd-4f6e-ae99-244539f9f022 1073741824" returned: 0 in 0.849s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1ab297ae-9efd-4f6e-ae99-244539f9f022 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1ab297ae-9efd-4f6e-ae99-244539f9f022" returned: 0 in 0.265s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] <== create_volume: return (1202ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:07:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025fb5be-e6a4-49e4-b287-f5c380e186fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab297ae-9efd-4f6e-ae99-244539f9f022', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67abfd4-6cf1-4113-9da3-151a8a277941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:04 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Volume volume-1ab297ae-9efd-4f6e-ae99-244539f9f022 (1ab297ae-9efd-4f6e-ae99-244539f9f022): created successfully
Sep 18 01:07:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67abfd4-6cf1-4113-9da3-151a8a277941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Flow 'volume_create_manager' (bdc5cd2e-18fe-4191-b2bb-c93deaa11864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:05 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-bc14a8c1-51ce-47e9-85de-005589af364f tempest-VolumesActionsTest-1477594842 None] Created volume successfully.
Sep 18 01:07:05 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-f631466d-c1c6-4f0e-b424-c064300850ae" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-f631466d-c1c6-4f0e-b424-c064300850ae" acquired by "delete_volume" :: waited 0.056s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:05 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c41785-bc79-4f16-87de-bf261e3c5f16]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f631466d-c1c6-4f0e-b424-c064300850ae {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f631466d-c1c6-4f0e-b424-c064300850ae" returned: 0 in 0.445s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f631466d-c1c6-4f0e-b424-c064300850ae {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8c901891-d14c-4f7a-815a-f8f3e138eec6 tempest-VolumesActionsTest-1477594842 None] Acquiring lock "cinder-1ab297ae-9efd-4f6e-ae99-244539f9f022" by "attach_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f631466d-c1c6-4f0e-b424-c064300850ae" returned: 0 in 0.295s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-f631466d-c1c6-4f0e-b424-c064300850ae" released by "delete_volume" :: held 0.855s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8c901891-d14c-4f7a-815a-f8f3e138eec6 tempest-VolumesActionsTest-1477594842 None] Lock "cinder-1ab297ae-9efd-4f6e-ae99-244539f9f022" acquired by "attach_volume" :: waited 0.223s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:06 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8c901891-d14c-4f7a-815a-f8f3e138eec6 tempest-VolumesActionsTest-1477594842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:06 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8c901891-d14c-4f7a-815a-f8f3e138eec6 tempest-VolumesActionsTest-1477594842 None] Attaching volume 1ab297ae-9efd-4f6e-ae99-244539f9f022 to instance 4ab95231-ae05-4b60-a487-261b2902995f at mountpoint /dev/vdb on host None.
Sep 18 01:07:06 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Created reservations ['5c8790c8-0b34-48e4-835e-d338dbd6a0c5'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:07:06 devstack cinder-volume[84134]: WARNING cinder.quota [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-184518309 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-184518309, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:07:06 devstack cinder-volume[84134]: WARNING cinder.quota [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-184518309 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-184518309, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:07:06 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8c901891-d14c-4f7a-815a-f8f3e138eec6 tempest-VolumesActionsTest-1477594842 None] Attach volume completed successfully.
Sep 18 01:07:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8c901891-d14c-4f7a-815a-f8f3e138eec6 tempest-VolumesActionsTest-1477594842 None] Lock "cinder-1ab297ae-9efd-4f6e-ae99-244539f9f022" released by "attach_volume" :: held 0.490s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:06 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Created reservations ['b0cec056-abb9-46e4-b218-ed05b268355c', 'b60ed857-db49-4449-b916-c4f0b27e005c', '5ccfab30-98c8-4ad0-b91e-00af53ce6176', '1c21f429-9fcc-465a-9faf-ff0de7c5a024'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:07:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.150s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:07 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:07:07 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-4d62f57e-8ade-426a-9928-d27c0224fa24 tempest-GroupSnapshotsTest-1402530406 None] Delete group completed successfully.
Sep 18 01:07:07 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] group_snapshot 0aad6a09-7597-4e85-bbff-38b1d648f4fc: deleting
Sep 18 01:07:07 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-959f1d88-c8af-48b6-a6cd-79d32e59fbef tempest-VolumesActionsTest-1397104740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:08 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-959f1d88-c8af-48b6-a6cd-79d32e59fbef tempest-VolumesActionsTest-1397104740 None] Terminate volume connection completed successfully.
Sep 18 01:07:08 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:08 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] group_snapshot 0aad6a09-7597-4e85-bbff-38b1d648f4fc: deleting {{(pid=84134) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 01:07:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-c75ac204-1c8f-48c5-8f5e-7f84ecedde39" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-c75ac204-1c8f-48c5-8f5e-7f84ecedde39" acquired by "delete_snapshot" :: waited 0.103s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-42d9ae6e-feb4-4aff-aa59-a347602de921" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-42d9ae6e-feb4-4aff-aa59-a347602de921" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:08 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Deleting offline snapshot 42d9ae6e-feb4-4aff-aa59-a347602de921 of volume c75ac204-1c8f-48c5-8f5e-7f84ecedde39 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:07:08 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] snapshot_file for this snap is: volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:07:08 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8908dde2-485d-4867-9cd0-ac67c1a7623c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-959f1d88-c8af-48b6-a6cd-79d32e59fbef tempest-VolumesActionsTest-1397104740 None] Acquiring lock "cinder-1ab297ae-9efd-4f6e-ae99-244539f9f022-detach_volume" by "detach_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-959f1d88-c8af-48b6-a6cd-79d32e59fbef tempest-VolumesActionsTest-1397104740 None] Lock "cinder-1ab297ae-9efd-4f6e-ae99-244539f9f022-detach_volume" acquired by "detach_volume" :: waited 0.218s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-70f98cfe-d5e2-40e8-a6d2-c8310ed6ad61 req-aef058f6-06e1-44e9-9404-0aabeb09c1a0 tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-70f98cfe-d5e2-40e8-a6d2-c8310ed6ad61 req-aef058f6-06e1-44e9-9404-0aabeb09c1a0 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:09 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-959f1d88-c8af-48b6-a6cd-79d32e59fbef tempest-VolumesActionsTest-1397104740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:09 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-959f1d88-c8af-48b6-a6cd-79d32e59fbef tempest-VolumesActionsTest-1397104740 None] Detaching volume 1ab297ae-9efd-4f6e-ae99-244539f9f022 from instance 4ab95231-ae05-4b60-a487-261b2902995f.
Sep 18 01:07:09 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-959f1d88-c8af-48b6-a6cd-79d32e59fbef tempest-VolumesActionsTest-1397104740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:09 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9b9ce0-4d91-433c-a995-a02ff2afd2e2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-70f98cfe-d5e2-40e8-a6d2-c8310ed6ad61 req-aef058f6-06e1-44e9-9404-0aabeb09c1a0 tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921" returned: 0 in 1.590s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:07:09 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[35aaebd6-de7a-4dea-a653-167de13109dd]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-70f98cfe-d5e2-40e8-a6d2-c8310ed6ad61 req-aef058f6-06e1-44e9-9404-0aabeb09c1a0 tempest-AttachVolumeNegativeTest-1787668276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2" returned: 0 in 0.867s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-70f98cfe-d5e2-40e8-a6d2-c8310ed6ad61 req-aef058f6-06e1-44e9-9404-0aabeb09c1a0 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.967s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:10 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-959f1d88-c8af-48b6-a6cd-79d32e59fbef tempest-VolumesActionsTest-1397104740 None] Detach volume completed successfully.
Sep 18 01:07:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-959f1d88-c8af-48b6-a6cd-79d32e59fbef tempest-VolumesActionsTest-1397104740 None] Lock "cinder-1ab297ae-9efd-4f6e-ae99-244539f9f022-detach_volume" released by "detach_volume" :: held 1.472s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:10 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-70f98cfe-d5e2-40e8-a6d2-c8310ed6ad61 req-aef058f6-06e1-44e9-9404-0aabeb09c1a0 tempest-AttachVolumeNegativeTest-1787668276 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f759dc06-8eed-4cc9-af05-450ac2c29010', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:07:10 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-70f98cfe-d5e2-40e8-a6d2-c8310ed6ad61 req-aef058f6-06e1-44e9-9404-0aabeb09c1a0 tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:10 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-70f98cfe-d5e2-40e8-a6d2-c8310ed6ad61 req-aef058f6-06e1-44e9-9404-0aabeb09c1a0 tempest-AttachVolumeNegativeTest-1787668276 None] attachment_update completed successfully.
Sep 18 01:07:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39" returned: 0 in 0.853s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:10 devstack quobyte-client[84147]: System call of process 92554 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:07:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921" returned: 0 in 0.315s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-207075c5-e9a4-4488-8a65-87a8c7c503a9 tempest-VolumesActionsTest-1477594842 None] Acquiring lock "cinder-1ab297ae-9efd-4f6e-ae99-244539f9f022-detach_volume" by "detach_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39.42d9ae6e-feb4-4aff-aa59-a347602de921" returned: 0 in 0.405s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-42d9ae6e-feb4-4aff-aa59-a347602de921" released by "_delete_snapshot" :: held 3.588s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-207075c5-e9a4-4488-8a65-87a8c7c503a9 tempest-VolumesActionsTest-1477594842 None] Lock "cinder-1ab297ae-9efd-4f6e-ae99-244539f9f022-detach_volume" acquired by "detach_volume" :: waited 0.195s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:11 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-207075c5-e9a4-4488-8a65-87a8c7c503a9 tempest-VolumesActionsTest-1477594842 None] Volume detach called, but volume not attached.
Sep 18 01:07:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-c75ac204-1c8f-48c5-8f5e-7f84ecedde39" released by "delete_snapshot" :: held 3.790s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-207075c5-e9a4-4488-8a65-87a8c7c503a9 tempest-VolumesActionsTest-1477594842 None] Lock "cinder-1ab297ae-9efd-4f6e-ae99-244539f9f022-detach_volume" released by "detach_volume" :: held 0.309s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:12 devstack cinder-volume[84134]: WARNING cinder.quota [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-184518309 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-184518309, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:07:12 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] Created reservations ['88e7d7b1-118e-48bf-b499-eae0e40e36d2', '6b0325f5-d4bd-43b5-bf42-5be7c8649b4a', 'd7051a98-0734-4692-a668-595baa128179', '6dc0f00a-28ce-41c2-ad57-f379bc09865d'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:07:12 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-f0d29faa-9aca-4add-9419-61ea9db9d19e tempest-GroupSnapshotsTest-1402530406 None] group_snapshot 0aad6a09-7597-4e85-bbff-38b1d648f4fc: deleted successfully
Sep 18 01:07:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Acquiring lock "cinder-1ab297ae-9efd-4f6e-ae99-244539f9f022-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Lock "cinder-1ab297ae-9efd-4f6e-ae99-244539f9f022-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:12 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Acquiring lock "cinder-quobyte-1ab297ae-9efd-4f6e-ae99-244539f9f022" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Lock "cinder-quobyte-1ab297ae-9efd-4f6e-ae99-244539f9f022" acquired by "delete_volume" :: waited 0.012s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:12 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f0eadb-165b-41af-a7c9-ef8bc633ea80]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1ab297ae-9efd-4f6e-ae99-244539f9f022 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:13 devstack quobyte-client[84147]: System call of process 92639 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:07:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1ab297ae-9efd-4f6e-ae99-244539f9f022" returned: 0 in 1.373s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:14 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1ab297ae-9efd-4f6e-ae99-244539f9f022 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:14 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-c75ac204-1c8f-48c5-8f5e-7f84ecedde39" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1ab297ae-9efd-4f6e-ae99-244539f9f022" returned: 0 in 0.434s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:14 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Lock "cinder-quobyte-1ab297ae-9efd-4f6e-ae99-244539f9f022" released by "delete_volume" :: held 1.909s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:14 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-c75ac204-1c8f-48c5-8f5e-7f84ecedde39" acquired by "delete_volume" :: waited 0.259s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:15 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ca7013-5f26-4864-b7d1-6f1e198b52ef]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:16 devstack quobyte-client[84147]: System call of process 92963 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:07:16 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Created reservations ['fa52df07-80ee-4050-bbfe-0be6db8ca93f', 'a114eac6-6cdf-46a2-af35-4666a42038a8', '1c04512a-ad79-4437-90cb-63493e2781f8', 'f4e8f457-8f1e-4411-8c8b-57bd72c32eff'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:07:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39" returned: 0 in 0.771s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c75ac204-1c8f-48c5-8f5e-7f84ecedde39" returned: 0 in 0.256s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-c75ac204-1c8f-48c5-8f5e-7f84ecedde39" released by "delete_volume" :: held 1.708s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Created reservations ['d58b0f6d-2e2a-4730-94f5-7f622cab145c'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.368s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:07:17 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Deleted volume successfully.
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d0469c66-2851-4014-a91a-a6888147c860 tempest-VolumesActionsTest-1477594842 None] Lock "cinder-1ab297ae-9efd-4f6e-ae99-244539f9f022-delete_volume" released by "delete_volume" :: held 4.785s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:17 devstack cinder-volume[84134]: WARNING cinder.db.sqlalchemy.api [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-184518309']
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Created reservations ['c1cb3577-f974-4f40-9878-8f588af57202', '29fd957b-f678-493a-8023-f3afe5b75893', 'cffb37ba-dd23-4932-a95b-7d7d67ada833', '8b5c7d8f-2b3c-4c4b-b833-2862c646f7d9'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.419s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:18 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:07:18 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-6f44dee7-98a4-4da3-9d21-17d89d3ac137 tempest-GroupSnapshotsTest-1402530406 None] Delete group completed successfully.
Sep 18 01:07:20 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-33bad053-d1ba-4206-95bf-00cd9b4fe377 tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:20 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-33bad053-d1ba-4206-95bf-00cd9b4fe377 tempest-GroupSnapshotsTest-1402530406 None] Group tempest-GroupSnapshotsTest-Group-2052663352: creating
Sep 18 01:07:20 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-33bad053-d1ba-4206-95bf-00cd9b4fe377 tempest-GroupSnapshotsTest-1402530406 None] Group tempest-GroupSnapshotsTest-Group-2052663352: created successfully
Sep 18 01:07:20 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-33bad053-d1ba-4206-95bf-00cd9b4fe377 tempest-GroupSnapshotsTest-1402530406 None] Create group completed successfully.
Sep 18 01:07:21 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Flow 'volume_create_manager' (7b3857df-17f2-460e-a88c-6e9abe63cff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce3d222-50e9-47bd-b0ae-dd9875869b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce3d222-50e9-47bd-b0ae-dd9875869b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1259771537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ddcf5ae2-a8e2-4017-bbc5-82f7bf2f3592,host='devstack@QuobyteHD#QuobyteHD',id=79e66ea6-7460-49f5-b4a8-0dcda4c9de4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844926cd9d8545eb9738543420ec7e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:07:21Z,use_quota=True,user_id='48397779f47b4547ae3bcef0a0637f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6453d741-d5d3-4f0f-9afb-0ea3ff1cbe63),volume_type_id=6453d741-d5d3-4f0f-9afb-0ea3ff1cbe63)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b42646-4880-4671-bf44-59fb460f4630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b42646-4880-4671-bf44-59fb460f4630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12571a0-6b5d-482c-9de6-89b9a2cfdf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12571a0-6b5d-482c-9de6-89b9a2cfdf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e66ea6-7460-49f5-b4a8-0dcda4c9de4a', 'volume_name': 'volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b90e23-26bb-4fee-b58c-75fde96db754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b90e23-26bb-4fee-b58c-75fde96db754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee8675e-5806-476d-adc4-e9a916f0290b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:21 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Volume 79e66ea6-7460-49f5-b4a8-0dcda4c9de4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a', 'volume_size': 1}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ddcf5ae2-a8e2-4017-bbc5-82f7bf2f3592,created_at=2025-09-17T23:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1259771537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ddcf5ae2-a8e2-4017-bbc5-82f7bf2f3592,host='devstack@QuobyteHD#QuobyteHD',id=79e66ea6-7460-49f5-b4a8-0dcda4c9de4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844926cd9d8545eb9738543420ec7e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:07:21Z,use_quota=True,user_id='48397779f47b4547ae3bcef0a0637f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6453d741-d5d3-4f0f-9afb-0ea3ff1cbe63),volume_type_id=6453d741-d5d3-4f0f-9afb-0ea3ff1cbe63)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Creating volume 79e66ea6-7460-49f5-b4a8-0dcda4c9de4a {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:07:21 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:07:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:21 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=35, name=volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:07:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a 1073741824" returned: 0 in 0.395s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a" returned: 0 in 0.163s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:22 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] <== create_volume: return (665ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:07:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee8675e-5806-476d-adc4-e9a916f0290b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e337795-182f-4f7e-a252-0cb0fba0be69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:22 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Volume volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a (79e66ea6-7460-49f5-b4a8-0dcda4c9de4a): created successfully
Sep 18 01:07:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e337795-182f-4f7e-a252-0cb0fba0be69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Flow 'volume_create_manager' (7b3857df-17f2-460e-a88c-6e9abe63cff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:22 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-48afd0da-bc2a-4e2d-900e-eedcfdf40e9b tempest-GroupSnapshotsTest-1402530406 None] Created volume successfully.
Sep 18 01:07:24 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Flow 'volume_create_manager' (c1511e72-4bfe-492c-ba73-0af6bf6524a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb6d182-d0a1-453a-9ee6-4ffcfc340478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb6d182-d0a1-453a-9ee6-4ffcfc340478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1630048083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ddcf5ae2-a8e2-4017-bbc5-82f7bf2f3592,host='devstack@QuobyteHD#QuobyteHD',id=4b2901ab-25a3-49a5-866c-7bdddf793854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844926cd9d8545eb9738543420ec7e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:07:25Z,use_quota=True,user_id='48397779f47b4547ae3bcef0a0637f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6453d741-d5d3-4f0f-9afb-0ea3ff1cbe63),volume_type_id=6453d741-d5d3-4f0f-9afb-0ea3ff1cbe63)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f859f492-757f-4672-8e28-972eaa116a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f859f492-757f-4672-8e28-972eaa116a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa22ecea-23ae-4ec5-a545-3816cf8b4db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa22ecea-23ae-4ec5-a545-3816cf8b4db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b2901ab-25a3-49a5-866c-7bdddf793854', 'volume_name': 'volume-4b2901ab-25a3-49a5-866c-7bdddf793854', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e9d9a9-238c-4018-8b3a-5d362aadabbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e9d9a9-238c-4018-8b3a-5d362aadabbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7e9fe3-93cd-47a0-9062-2a13c27c64d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:24 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Volume 4b2901ab-25a3-49a5-866c-7bdddf793854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b2901ab-25a3-49a5-866c-7bdddf793854', 'volume_size': 1}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ddcf5ae2-a8e2-4017-bbc5-82f7bf2f3592,created_at=2025-09-17T23:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1630048083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ddcf5ae2-a8e2-4017-bbc5-82f7bf2f3592,host='devstack@QuobyteHD#QuobyteHD',id=4b2901ab-25a3-49a5-866c-7bdddf793854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844926cd9d8545eb9738543420ec7e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:07:25Z,use_quota=True,user_id='48397779f47b4547ae3bcef0a0637f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6453d741-d5d3-4f0f-9afb-0ea3ff1cbe63),volume_type_id=6453d741-d5d3-4f0f-9afb-0ea3ff1cbe63)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Creating volume 4b2901ab-25a3-49a5-866c-7bdddf793854 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:07:24 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:07:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:24 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=36, name=volume-4b2901ab-25a3-49a5-866c-7bdddf793854, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:07:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854 1073741824" returned: 0 in 0.381s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854" returned: 0 in 0.122s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] <== create_volume: return (616ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:07:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.629s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7e9fe3-93cd-47a0-9062-2a13c27c64d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2901ab-25a3-49a5-866c-7bdddf793854', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2b39e6-03cf-4353-9e90-d0dfd3b2043c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:25 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Volume volume-4b2901ab-25a3-49a5-866c-7bdddf793854 (4b2901ab-25a3-49a5-866c-7bdddf793854): created successfully
Sep 18 01:07:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2b39e6-03cf-4353-9e90-d0dfd3b2043c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Flow 'volume_create_manager' (c1511e72-4bfe-492c-ba73-0af6bf6524a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:25 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-4cb9b2a0-268a-420a-a28e-7743b17d8e5f tempest-GroupSnapshotsTest-1402530406 None] Created volume successfully.
Sep 18 01:07:27 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-2c203317-f683-45a1-96b0-1a3a95a357cd tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:27 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-2c203317-f683-45a1-96b0-1a3a95a357cd tempest-GroupSnapshotsTest-1402530406 None] Update group completed successfully.
Sep 18 01:07:27 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Flow 'volume_create_manager' (33112a32-a25b-498c-a684-ca01ef58d984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4b0d04-efda-4c26-a433-cc3a2ff26289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4b0d04-efda-4c26-a433-cc3a2ff26289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1617676944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ab1405-855a-440b-b051-6255776dedd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c4b34bb7a4888a6449fa1babffe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:07:27Z,use_quota=True,user_id='ddfc4ea998b94c9aadad1c3c5ac8874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e48c98-5e9d-41bf-8430-33b8c9064afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e48c98-5e9d-41bf-8430-33b8c9064afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23eddade-a79c-4d97-ac09-26bcc34f8291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23eddade-a79c-4d97-ac09-26bcc34f8291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ab1405-855a-440b-b051-6255776dedd5', 'volume_name': 'volume-94ab1405-855a-440b-b051-6255776dedd5', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bab9ee6-54d5-46d2-9587-54f7d9735c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bab9ee6-54d5-46d2-9587-54f7d9735c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (120803f6-283c-444f-8273-c3cc64791c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:27 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Volume 94ab1405-855a-440b-b051-6255776dedd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ab1405-855a-440b-b051-6255776dedd5', 'volume_size': 1}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1617676944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ab1405-855a-440b-b051-6255776dedd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c4b34bb7a4888a6449fa1babffe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:07:27Z,use_quota=True,user_id='ddfc4ea998b94c9aadad1c3c5ac8874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Creating volume 94ab1405-855a-440b-b051-6255776dedd5 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:07:27 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-94ab1405-855a-440b-b051-6255776dedd5 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:27 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=37, name=volume-94ab1405-855a-440b-b051-6255776dedd5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-94ab1405-855a-440b-b051-6255776dedd5 1073741824" returned: 0 in 0.344s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-94ab1405-855a-440b-b051-6255776dedd5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-94ab1405-855a-440b-b051-6255776dedd5" returned: 0 in 0.079s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] <== create_volume: return (483ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:07:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.497s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (120803f6-283c-444f-8273-c3cc64791c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ab1405-855a-440b-b051-6255776dedd5', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61d8361-0933-4e9b-8ae5-473f9e5a312f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:28 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-82b04d4f-6cd8-4561-a231-125dc48b5ecd tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:28 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Volume volume-94ab1405-855a-440b-b051-6255776dedd5 (94ab1405-855a-440b-b051-6255776dedd5): created successfully
Sep 18 01:07:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61d8361-0933-4e9b-8ae5-473f9e5a312f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Flow 'volume_create_manager' (33112a32-a25b-498c-a684-ca01ef58d984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:28 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e12b384b-e327-442e-a6bf-cbb9616843eb tempest-VolumesActionsTest-1477594842 None] Created volume successfully.
Sep 18 01:07:28 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-82b04d4f-6cd8-4561-a231-125dc48b5ecd tempest-GroupSnapshotsTest-1402530406 None] Update group completed successfully.
Sep 18 01:07:29 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-c2307908-1f78-4c73-95db-ef3885b3f719 tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:29 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-c2307908-1f78-4c73-95db-ef3885b3f719 tempest-GroupSnapshotsTest-1402530406 None] Update group completed successfully.
Sep 18 01:07:29 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Acquiring lock "cinder-94ab1405-855a-440b-b051-6255776dedd5-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:29 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Lock "cinder-94ab1405-855a-440b-b051-6255776dedd5-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:29 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:29 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Acquiring lock "cinder-quobyte-94ab1405-855a-440b-b051-6255776dedd5" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:29 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Lock "cinder-quobyte-94ab1405-855a-440b-b051-6255776dedd5" acquired by "delete_volume" :: waited 0.017s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:29 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f4b82c-dca0-4e0d-8a7f-2d8f3a6500ec]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-94ab1405-855a-440b-b051-6255776dedd5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-94ab1405-855a-440b-b051-6255776dedd5" returned: 0 in 0.543s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-94ab1405-855a-440b-b051-6255776dedd5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-94ab1405-855a-440b-b051-6255776dedd5" returned: 0 in 0.106s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Lock "cinder-quobyte-94ab1405-855a-440b-b051-6255776dedd5" released by "delete_volume" :: held 1.147s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:31 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-06f49220-037f-4af0-b416-dc8dd80c5739 tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:31 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-06f49220-037f-4af0-b416-dc8dd80c5739 tempest-GroupSnapshotsTest-1402530406 None] Update group completed successfully.
Sep 18 01:07:31 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Created reservations ['5540cb88-0e39-482e-8c9f-b9a2b33227bf', '27658d25-fa90-4ddb-a83f-aceb0c6a3f35', 'dc1ccd99-ed15-4965-82b9-1e9fa7e98e85', '60f97289-9ca3-4d96-81e8-fd94cbfbc219'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:07:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.235s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:31 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:07:31 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Deleted volume successfully.
Sep 18 01:07:32 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4b95ff29-1745-404f-b9a8-ee7c9ae24ea3 tempest-VolumesActionsTest-1397104740 None] Lock "cinder-94ab1405-855a-440b-b051-6255776dedd5-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:32 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] GroupSnapshot 43da30a7-0d61-4971-872d-240e77af810e: creating.
Sep 18 01:07:33 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Group snapshot 43da30a7-0d61-4971-872d-240e77af810e: creating. {{(pid=84134) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 01:07:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Creating offline snapshot 65f21aa0-47c8-42a5-bf41-303d6d51c075 of volume 79e66ea6-7460-49f5-b4a8-0dcda4c9de4a {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:07:33 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:33 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:07:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Flow 'volume_create_manager' (81866f6b-aeb1-4e79-a1fe-62ef226bab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231506fd-56bf-408d-95eb-b518af0b8a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:33 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39cfbf2-c91b-44a5-bcbd-e12c0be59a62]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231506fd-56bf-408d-95eb-b518af0b8a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1107392719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb72a433-6cfa-462a-83ee-89deceabd745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c4b34bb7a4888a6449fa1babffe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:07:33Z,use_quota=True,user_id='ddfc4ea998b94c9aadad1c3c5ac8874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e974ee-ef25-45b9-87cf-7bc86ab39654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e974ee-ef25-45b9-87cf-7bc86ab39654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b33fcc-1c50-4dea-b0ec-d6dbd533f27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b33fcc-1c50-4dea-b0ec-d6dbd533f27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb72a433-6cfa-462a-83ee-89deceabd745', 'volume_name': 'volume-eb72a433-6cfa-462a-83ee-89deceabd745', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf724c2-79b5-40fa-bb88-52f8e956993e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf724c2-79b5-40fa-bb88-52f8e956993e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21413170-8751-4c61-969f-198380928890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:34 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Volume eb72a433-6cfa-462a-83ee-89deceabd745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb72a433-6cfa-462a-83ee-89deceabd745', 'volume_size': 1}
Sep 18 01:07:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:34 devstack quobyte-client[84147]: System call of process 93069 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:07:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a" returned: 0 in 0.858s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:34 devstack quobyte-client[84147]: System call of process 93075 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:07:34 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=38, name=volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:07:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075 1G" returned: 0 in 0.392s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img rebase -u -b volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img rebase -u -b volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075" returned: 0 in 0.221s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075" returned: 0 in 0.120s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075" returned: 0 in 0.136s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.info" returned: 0 in 0.105s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.info" returned: 0 in 0.095s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Creating offline snapshot 97ddf768-75dd-4073-b02c-44d111b5591d of volume 4b2901ab-25a3-49a5-866c-7bdddf793854 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:07:36 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2a9a65-d79d-4793-89b6-3a9c9bf23b05]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854" returned: 0 in 0.496s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:36 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=40, name=volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:07:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d 1G" returned: 0 in 0.200s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4b2901ab-25a3-49a5-866c-7bdddf793854 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img rebase -u -b volume-4b2901ab-25a3-49a5-866c-7bdddf793854 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d" returned: 0 in 0.228s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d" returned: 0 in 0.111s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d" returned: 0 in 0.082s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.info" returned: 0 in 0.103s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.info" returned: 0 in 0.095s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.656s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1107392719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb72a433-6cfa-462a-83ee-89deceabd745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c4b34bb7a4888a6449fa1babffe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:07:33Z,use_quota=True,user_id='ddfc4ea998b94c9aadad1c3c5ac8874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Creating volume eb72a433-6cfa-462a-83ee-89deceabd745 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:07:37 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:07:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-eb72a433-6cfa-462a-83ee-89deceabd745 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:37 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=42, name=volume-eb72a433-6cfa-462a-83ee-89deceabd745, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:07:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-eb72a433-6cfa-462a-83ee-89deceabd745 1073741824" returned: 0 in 0.382s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-eb72a433-6cfa-462a-83ee-89deceabd745 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-eb72a433-6cfa-462a-83ee-89deceabd745" returned: 0 in 0.314s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] <== create_volume: return (762ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:07:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21413170-8751-4c61-969f-198380928890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb72a433-6cfa-462a-83ee-89deceabd745', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029e0707-2ff5-40a0-a477-c72e250fbb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:38 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Volume volume-eb72a433-6cfa-462a-83ee-89deceabd745 (eb72a433-6cfa-462a-83ee-89deceabd745): created successfully
Sep 18 01:07:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029e0707-2ff5-40a0-a477-c72e250fbb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Flow 'volume_create_manager' (81866f6b-aeb1-4e79-a1fe-62ef226bab53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:38 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3cbf546f-5aa0-4823-8e09-d1546904fef6 tempest-VolumesActionsTest-1477594842 None] Created volume successfully.
Sep 18 01:07:38 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-65a8ec64-63a6-4a2e-a780-02c3d6a2a3ed tempest-GroupSnapshotsTest-1402530406 None] group_snapshot 43da30a7-0d61-4971-872d-240e77af810e: created successfully
Sep 18 01:07:39 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] group_snapshot 43da30a7-0d61-4971-872d-240e77af810e: deleting
Sep 18 01:07:39 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] group_snapshot 43da30a7-0d61-4971-872d-240e77af810e: deleting {{(pid=84134) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 01:07:39 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:39 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a" acquired by "delete_snapshot" :: waited 0.046s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:39 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-65f21aa0-47c8-42a5-bf41-303d6d51c075" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:39 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-65f21aa0-47c8-42a5-bf41-303d6d51c075" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Deleting offline snapshot 65f21aa0-47c8-42a5-bf41-303d6d51c075 of volume 79e66ea6-7460-49f5-b4a8-0dcda4c9de4a {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:07:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] snapshot_file for this snap is: volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:07:39 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[171b7726-ca7a-43ff-bbf6-86501fe292d3]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:40 devstack quobyte-client[84147]: System call of process 93115 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:07:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Acquiring lock "cinder-eb72a433-6cfa-462a-83ee-89deceabd745-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075" returned: 0 in 0.789s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:07:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Lock "cinder-eb72a433-6cfa-462a-83ee-89deceabd745-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:40 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[264103e5-72b5-4dcb-a65e-bab13b4e2ddb]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:41 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:41 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Acquiring lock "cinder-quobyte-eb72a433-6cfa-462a-83ee-89deceabd745" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a" returned: 0 in 0.893s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Lock "cinder-quobyte-eb72a433-6cfa-462a-83ee-89deceabd745" acquired by "delete_volume" :: waited 0.799s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:42 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[746a0460-bfd1-4c82-b290-38eef749d0cc]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-eb72a433-6cfa-462a-83ee-89deceabd745 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075" returned: 0 in 0.811s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a.65f21aa0-47c8-42a5-bf41-303d6d51c075" returned: 0 in 0.422s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-65f21aa0-47c8-42a5-bf41-303d6d51c075" released by "_delete_snapshot" :: held 3.975s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a" released by "delete_snapshot" :: held 4.007s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-4b2901ab-25a3-49a5-866c-7bdddf793854" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-eb72a433-6cfa-462a-83ee-89deceabd745" returned: 0 in 1.610s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-eb72a433-6cfa-462a-83ee-89deceabd745 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-4b2901ab-25a3-49a5-866c-7bdddf793854" acquired by "delete_snapshot" :: waited 0.272s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-97ddf768-75dd-4073-b02c-44d111b5591d" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-eb72a433-6cfa-462a-83ee-89deceabd745" returned: 0 in 0.340s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Lock "cinder-quobyte-eb72a433-6cfa-462a-83ee-89deceabd745" released by "delete_volume" :: held 2.350s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-97ddf768-75dd-4073-b02c-44d111b5591d" acquired by "_delete_snapshot" :: waited 0.466s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:44 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Deleting offline snapshot 97ddf768-75dd-4073-b02c-44d111b5591d of volume 4b2901ab-25a3-49a5-866c-7bdddf793854 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:07:44 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] snapshot_file for this snap is: volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:07:44 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[549d2e54-9e27-40d9-8620-e815e433c1ba]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:45 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Created reservations ['277ffb00-542a-47a4-a4a1-b38b4e8f290f', '9ebeee9d-8d4d-4910-910a-a08f1075754f', '8d8406ac-61a3-49b6-9135-666ddbb05deb', '9f791437-811d-4a8a-93b7-686d392419ad'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:07:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d" returned: 0 in 0.828s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b2901ab-25a3-49a5-866c-7bdddf793854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:07:45 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55a7414-4e86-4038-af12-63e5c6f05f71]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:46 devstack quobyte-client[84147]: System call of process 93184 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:07:46 devstack quobyte-client[84147]: System call of process 93184 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:07:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.106s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.090s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854" returned: 0 in 1.355s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 1.262s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d" returned: 0 in 0.933s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:48 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Deleted volume successfully.
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:48 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Flow 'volume_create_manager' (020f6683-a721-4b79-8503-6424902df057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a630539e-8213-4a7d-b28b-4071ef75bd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854.97ddf768-75dd-4073-b02c-44d111b5591d" returned: 0 in 0.691s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-536daf15-3423-4463-a57c-5259fc707735 tempest-VolumesActionsTest-1397104740 None] Lock "cinder-eb72a433-6cfa-462a-83ee-89deceabd745-delete_volume" released by "delete_volume" :: held 8.522s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a630539e-8213-4a7d-b28b-4071ef75bd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-493881936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c826863-e49c-4873-9e8c-03643344834b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c4b34bb7a4888a6449fa1babffe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:07:47Z,use_quota=True,user_id='ddfc4ea998b94c9aadad1c3c5ac8874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668b495b-c796-47dd-b6c9-4d003a252c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668b495b-c796-47dd-b6c9-4d003a252c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f13a749-4755-4f28-8cc9-8f84e6c923a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f13a749-4755-4f28-8cc9-8f84e6c923a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c826863-e49c-4873-9e8c-03643344834b', 'volume_name': 'volume-3c826863-e49c-4873-9e8c-03643344834b', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0978bdf8-3800-420a-9f22-46183e673d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0978bdf8-3800-420a-9f22-46183e673d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d1893b-22a7-4e17-94a3-4c9b36c6715e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:48 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Volume 3c826863-e49c-4873-9e8c-03643344834b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c826863-e49c-4873-9e8c-03643344834b', 'volume_size': 1}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-493881936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c826863-e49c-4873-9e8c-03643344834b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c4b34bb7a4888a6449fa1babffe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:07:47Z,use_quota=True,user_id='ddfc4ea998b94c9aadad1c3c5ac8874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Creating volume 3c826863-e49c-4873-9e8c-03643344834b {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:07:48 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:07:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3c826863-e49c-4873-9e8c-03643344834b 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:49 devstack quobyte-client[84147]: System call of process 93200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:07:49 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-97ddf768-75dd-4073-b02c-44d111b5591d" released by "_delete_snapshot" :: held 4.491s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:49 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=43, name=volume-3c826863-e49c-4873-9e8c-03643344834b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:07:49 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-4b2901ab-25a3-49a5-866c-7bdddf793854" released by "delete_snapshot" :: held 5.176s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3c826863-e49c-4873-9e8c-03643344834b 1073741824" returned: 0 in 0.566s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3c826863-e49c-4873-9e8c-03643344834b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3c826863-e49c-4873-9e8c-03643344834b" returned: 0 in 0.358s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] <== create_volume: return (964ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:07:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d1893b-22a7-4e17-94a3-4c9b36c6715e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c826863-e49c-4873-9e8c-03643344834b', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e290e489-2a51-4283-bd3e-4449cb341776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:50 devstack cinder-volume[84134]: WARNING cinder.quota [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-513854740 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-513854740, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:07:50 devstack cinder-volume[84134]: WARNING cinder.quota [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-513854740 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-513854740, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:07:50 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Volume volume-3c826863-e49c-4873-9e8c-03643344834b (3c826863-e49c-4873-9e8c-03643344834b): created successfully
Sep 18 01:07:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e290e489-2a51-4283-bd3e-4449cb341776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Flow 'volume_create_manager' (020f6683-a721-4b79-8503-6424902df057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:50 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Created reservations ['66a72c2c-332d-4f08-9345-f2b883d9cc0e', 'c02de7b9-dcdf-428e-8ae5-329275400e3f', '43596779-143a-4814-b594-e56818fce99a', '6e9ebbc4-0524-4037-bb26-765043378480'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:07:50 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-65a99f81-da19-44ef-a8aa-5e66eaca4eda tempest-VolumesActionsTest-1477594842 None] Created volume successfully.
Sep 18 01:07:50 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] Created reservations ['f280415c-c940-4d7a-9fa2-82037c907646', '221fb35d-98cd-45ef-ad5d-912d1148697f', 'a6451226-2482-4dd7-b352-8bdb88ee66ad', 'f6a4263d-a033-4af9-8ae6-8726b65dd287'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:07:50 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-edb49199-08dc-4125-9628-dcfc1926d75c tempest-GroupSnapshotsTest-1402530406 None] group_snapshot 43da30a7-0d61-4971-872d-240e77af810e: deleted successfully
Sep 18 01:07:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Acquiring lock "cinder-3c826863-e49c-4873-9e8c-03643344834b-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Lock "cinder-3c826863-e49c-4873-9e8c-03643344834b-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:51 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-4b2901ab-25a3-49a5-866c-7bdddf793854" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:51 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Acquiring lock "cinder-quobyte-3c826863-e49c-4873-9e8c-03643344834b" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-4b2901ab-25a3-49a5-866c-7bdddf793854" acquired by "delete_volume" :: waited 0.070s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Lock "cinder-quobyte-3c826863-e49c-4873-9e8c-03643344834b" acquired by "delete_volume" :: waited 0.056s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:51 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b50049-b82e-4ba6-9b26-ec40b2c98c79]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:51 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec40cea4-2ced-4722-9cbc-94b88910ff4b]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3c826863-e49c-4873-9e8c-03643344834b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854" returned: 0 in 0.924s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3c826863-e49c-4873-9e8c-03643344834b" returned: 0 in 1.147s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3c826863-e49c-4873-9e8c-03643344834b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b2901ab-25a3-49a5-866c-7bdddf793854" returned: 0 in 0.443s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3c826863-e49c-4873-9e8c-03643344834b" returned: 0 in 0.329s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-4b2901ab-25a3-49a5-866c-7bdddf793854" released by "delete_volume" :: held 1.765s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:07:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Lock "cinder-quobyte-3c826863-e49c-4873-9e8c-03643344834b" released by "delete_volume" :: held 1.800s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a" acquired by "delete_volume" :: waited 0.192s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:07:53 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[24853b61-9709-496c-b780-73a804d788f6]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:07:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a" returned: 0 in 0.744s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:54 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Created reservations ['d32ccd53-9b64-4507-954d-0bcf986e4385', '0ef944b2-39a2-46ab-ac83-1593f8d4fb5e', '035b527b-f457-40a3-a5a5-0ec6d4506f93', '4fdabd47-28fc-47d0-b3cd-20aa93dcb9b5'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:07:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a" returned: 0 in 0.778s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-79e66ea6-7460-49f5-b4a8-0dcda4c9de4a" released by "delete_volume" :: held 1.829s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:07:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.075s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 2.231s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 1.160s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:07:58 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Deleted volume successfully.
Sep 18 01:07:58 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Flow 'volume_create_manager' (f0b96918-69f4-4de2-b878-dc5ece05dde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a63cb81-7b57-4bcb-95e3-ed8f45ba6597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a63cb81-7b57-4bcb-95e3-ed8f45ba6597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1470922847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=799941ba-ae4e-4038-8038-0f672c85c380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c4b34bb7a4888a6449fa1babffe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:07:57Z,use_quota=True,user_id='ddfc4ea998b94c9aadad1c3c5ac8874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9fd34d-213a-4706-b30c-613966803301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9fd34d-213a-4706-b30c-613966803301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f4f5db-3ca5-4878-914c-8672979029f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f4f5db-3ca5-4878-914c-8672979029f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '799941ba-ae4e-4038-8038-0f672c85c380', 'volume_name': 'volume-799941ba-ae4e-4038-8038-0f672c85c380', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ee4f48-1ef3-43df-99e3-a2b95b4fd191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ee4f48-1ef3-43df-99e3-a2b95b4fd191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668079ee-22c4-4285-8391-547a0a25604f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:58 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Volume 799941ba-ae4e-4038-8038-0f672c85c380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-799941ba-ae4e-4038-8038-0f672c85c380', 'volume_size': 1}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1470922847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=799941ba-ae4e-4038-8038-0f672c85c380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c4b34bb7a4888a6449fa1babffe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:07:57Z,use_quota=True,user_id='ddfc4ea998b94c9aadad1c3c5ac8874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Creating volume 799941ba-ae4e-4038-8038-0f672c85c380 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:07:58 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-799941ba-ae4e-4038-8038-0f672c85c380 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:58 devstack quobyte-client[84147]: System call of process 93255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:07:58 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=44, name=volume-799941ba-ae4e-4038-8038-0f672c85c380, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:07:58 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Created reservations ['6ebf9ce9-364d-4114-8d34-73691eb7f45c'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:07:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cb9472e9-a121-49c9-a47d-9751aa64f424 tempest-VolumesActionsTest-1397104740 None] Lock "cinder-3c826863-e49c-4873-9e8c-03643344834b-delete_volume" released by "delete_volume" :: held 7.631s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:07:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-799941ba-ae4e-4038-8038-0f672c85c380 1073741824" returned: 0 in 0.658s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-799941ba-ae4e-4038-8038-0f672c85c380 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:07:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-799941ba-ae4e-4038-8038-0f672c85c380" returned: 0 in 0.436s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:07:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] <== create_volume: return (1131ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:07:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:07:59 devstack cinder-volume[84134]: WARNING cinder.quota [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-513854740 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-513854740, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:07:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668079ee-22c4-4285-8391-547a0a25604f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-799941ba-ae4e-4038-8038-0f672c85c380', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80701297-bb83-4a87-b0e8-977f9740599c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:07:59 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Created reservations ['3d321c9f-d215-4143-b5bf-c6caa2cebb23', 'ea5b7bd0-4fb6-49cd-ae66-9cddacc0d13c', '555c50e8-f85f-425f-8715-793d97766d51', '1f38f32a-139b-4ec3-85e6-f236ef695e64'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:07:59 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Volume volume-799941ba-ae4e-4038-8038-0f672c85c380 (799941ba-ae4e-4038-8038-0f672c85c380): created successfully
Sep 18 01:07:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80701297-bb83-4a87-b0e8-977f9740599c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:07:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Flow 'volume_create_manager' (f0b96918-69f4-4de2-b878-dc5ece05dde0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:07:59 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-faecabe2-3c3e-45ec-9424-1720ade4a14d tempest-VolumesActionsTest-1477594842 None] Created volume successfully.
Sep 18 01:08:00 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Created reservations ['ed7e4e0e-9717-4b26-b3b2-ec3b8113b788', 'c30c7242-bea3-4782-a658-187b7d9f044a', '9a8e33bb-3448-4f03-9511-7bf16985e03d', 'a5b6e337-407c-4f56-b277-9bd89caa2d96'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:08:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.131s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:00 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:08:00 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-957542df-95a1-4070-90bb-875f737a9361 tempest-GroupSnapshotsTest-1402530406 None] Delete group completed successfully.
Sep 18 01:08:00 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Acquiring lock "cinder-799941ba-ae4e-4038-8038-0f672c85c380-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:00 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Lock "cinder-799941ba-ae4e-4038-8038-0f672c85c380-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:01 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Acquiring lock "cinder-quobyte-799941ba-ae4e-4038-8038-0f672c85c380" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Lock "cinder-quobyte-799941ba-ae4e-4038-8038-0f672c85c380" acquired by "delete_volume" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:01 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[69388a45-469d-4e1b-9525-ce3211676368]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:08:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-799941ba-ae4e-4038-8038-0f672c85c380 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:01 devstack quobyte-client[84147]: System call of process 93261 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:08:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-799941ba-ae4e-4038-8038-0f672c85c380" returned: 0 in 0.608s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-799941ba-ae4e-4038-8038-0f672c85c380 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-799941ba-ae4e-4038-8038-0f672c85c380" returned: 0 in 0.171s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:02 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=107,cinder:UPDATE=125,cinder:DELETE=8,cinder:INSERT=26 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:08:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Lock "cinder-quobyte-799941ba-ae4e-4038-8038-0f672c85c380" released by "delete_volume" :: held 1.219s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:02 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=116,cinder:SELECT=116,cinder:INSERT=23,cinder:DELETE=4 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:08:02 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-28a664fa-ba20-4247-b018-8978c30d3ed2 tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:02 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-28a664fa-ba20-4247-b018-8978c30d3ed2 tempest-GroupSnapshotsTest-1402530406 None] Group tempest-GroupSnapshotsTest-Group-821196606: creating
Sep 18 01:08:02 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Created reservations ['05c394dd-3e9e-42ea-896f-c194890797d3', '5618c888-f09e-43f5-83b2-1b1db9b8fba0', '8b467e1d-52a3-44c8-a9e8-07360cb2c987', '39496f20-3220-48ff-985d-0c20fa0b07fd'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:08:02 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-28a664fa-ba20-4247-b018-8978c30d3ed2 tempest-GroupSnapshotsTest-1402530406 None] Group tempest-GroupSnapshotsTest-Group-821196606: created successfully
Sep 18 01:08:02 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-28a664fa-ba20-4247-b018-8978c30d3ed2 tempest-GroupSnapshotsTest-1402530406 None] Create group completed successfully.
Sep 18 01:08:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.164s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:02 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:08:03 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Deleted volume successfully.
Sep 18 01:08:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bcbc89b7-cc40-429f-a4f6-ac32cc2bd19a tempest-VolumesActionsTest-1397104740 None] Lock "cinder-799941ba-ae4e-4038-8038-0f672c85c380-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:04 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Flow 'volume_create_manager' (3af380ed-1204-40d2-a298-d2140de126ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c1694a-165a-4df0-994d-f0f18ef96932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c1694a-165a-4df0-994d-f0f18ef96932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2028792180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719012e0-331a-461c-813d-194e79c60eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c4b34bb7a4888a6449fa1babffe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:08:04Z,use_quota=True,user_id='ddfc4ea998b94c9aadad1c3c5ac8874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586cec20-1096-467b-a1ad-1c6003403f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586cec20-1096-467b-a1ad-1c6003403f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b6b292-4609-4d44-b92e-c98e1189a1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b6b292-4609-4d44-b92e-c98e1189a1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '719012e0-331a-461c-813d-194e79c60eb3', 'volume_name': 'volume-719012e0-331a-461c-813d-194e79c60eb3', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae522ffd-6434-4354-9bb9-99e128e30cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae522ffd-6434-4354-9bb9-99e128e30cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52079d94-eaed-4338-865d-348be117dca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:04 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Volume 719012e0-331a-461c-813d-194e79c60eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-719012e0-331a-461c-813d-194e79c60eb3', 'volume_size': 1}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2028792180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719012e0-331a-461c-813d-194e79c60eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6c4b34bb7a4888a6449fa1babffe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:08:04Z,use_quota=True,user_id='ddfc4ea998b94c9aadad1c3c5ac8874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Creating volume 719012e0-331a-461c-813d-194e79c60eb3 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:08:04 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-719012e0-331a-461c-813d-194e79c60eb3 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:04 devstack quobyte-client[84147]: System call of process 93267 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:08:04 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=45, name=volume-719012e0-331a-461c-813d-194e79c60eb3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:08:04 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Flow 'volume_create_manager' (ef506412-305d-4fef-afb8-594e198ef1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f625b1e9-f4c8-491a-a673-e9bd6a349c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-719012e0-331a-461c-813d-194e79c60eb3 1073741824" returned: 0 in 0.583s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-719012e0-331a-461c-813d-194e79c60eb3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f625b1e9-f4c8-491a-a673-e9bd6a349c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1621583739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=80913145-2b27-4a4c-9fba-7f3accc3397c,host='devstack@QuobyteHD#QuobyteHD',id=018539db-5f90-4cb8-a8f8-dae26b70050a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844926cd9d8545eb9738543420ec7e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:08:04Z,use_quota=True,user_id='48397779f47b4547ae3bcef0a0637f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8371d998-b6b5-4395-98ef-9a6f530bb87f),volume_type_id=8371d998-b6b5-4395-98ef-9a6f530bb87f)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ae9847-e267-4319-88e3-ba9c2d202a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ae9847-e267-4319-88e3-ba9c2d202a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b5ea0d-c2ba-4249-a5d1-e0cb654de65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b5ea0d-c2ba-4249-a5d1-e0cb654de65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '018539db-5f90-4cb8-a8f8-dae26b70050a', 'volume_name': 'volume-018539db-5f90-4cb8-a8f8-dae26b70050a', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ad5d6b-846d-45e0-b49e-2c0cfbefceb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ad5d6b-846d-45e0-b49e-2c0cfbefceb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d81f44c-a175-4b0d-a0ab-04f68a1006fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:05 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Volume 018539db-5f90-4cb8-a8f8-dae26b70050a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-018539db-5f90-4cb8-a8f8-dae26b70050a', 'volume_size': 1}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-719012e0-331a-461c-813d-194e79c60eb3" returned: 0 in 0.349s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] <== create_volume: return (951ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.119s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=80913145-2b27-4a4c-9fba-7f3accc3397c,created_at=2025-09-17T23:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1621583739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=80913145-2b27-4a4c-9fba-7f3accc3397c,host='devstack@QuobyteHD#QuobyteHD',id=018539db-5f90-4cb8-a8f8-dae26b70050a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844926cd9d8545eb9738543420ec7e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:08:04Z,use_quota=True,user_id='48397779f47b4547ae3bcef0a0637f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8371d998-b6b5-4395-98ef-9a6f530bb87f),volume_type_id=8371d998-b6b5-4395-98ef-9a6f530bb87f)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Creating volume 018539db-5f90-4cb8-a8f8-dae26b70050a {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:08:05 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:05 devstack quobyte-client[84147]: System call of process 93273 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:08:05 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=46, name=volume-018539db-5f90-4cb8-a8f8-dae26b70050a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52079d94-eaed-4338-865d-348be117dca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-719012e0-331a-461c-813d-194e79c60eb3', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20004396-794b-4de9-a83a-a0327c39260a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:05 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Volume volume-719012e0-331a-461c-813d-194e79c60eb3 (719012e0-331a-461c-813d-194e79c60eb3): created successfully
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20004396-794b-4de9-a83a-a0327c39260a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Flow 'volume_create_manager' (3af380ed-1204-40d2-a298-d2140de126ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a 1073741824" returned: 0 in 0.470s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:06 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-47ecd7a2-e84b-4dae-b422-b641bff84205 tempest-VolumesActionsTest-1477594842 None] Created volume successfully.
Sep 18 01:08:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a" returned: 0 in 0.363s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:06 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] <== create_volume: return (859ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:08:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:06 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d81f44c-a175-4b0d-a0ab-04f68a1006fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018539db-5f90-4cb8-a8f8-dae26b70050a', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:06 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b6d518-086e-43d3-bf62-1ab8839b793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:06 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Volume volume-018539db-5f90-4cb8-a8f8-dae26b70050a (018539db-5f90-4cb8-a8f8-dae26b70050a): created successfully
Sep 18 01:08:06 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b6d518-086e-43d3-bf62-1ab8839b793f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:06 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Flow 'volume_create_manager' (ef506412-305d-4fef-afb8-594e198ef1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:08:06 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5606c0ed-9eb4-4895-8553-c010b6628c6a tempest-GroupSnapshotsTest-1402530406 None] Created volume successfully.
Sep 18 01:08:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Acquiring lock "cinder-719012e0-331a-461c-813d-194e79c60eb3-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Lock "cinder-719012e0-331a-461c-813d-194e79c60eb3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:07 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Acquiring lock "cinder-quobyte-719012e0-331a-461c-813d-194e79c60eb3" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Lock "cinder-quobyte-719012e0-331a-461c-813d-194e79c60eb3" acquired by "delete_volume" :: waited 0.026s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:07 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[24df5e41-0e75-4de9-86b0-53c7a31e3a4f]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:08:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-719012e0-331a-461c-813d-194e79c60eb3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-719012e0-331a-461c-813d-194e79c60eb3" returned: 0 in 0.546s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-719012e0-331a-461c-813d-194e79c60eb3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:08 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] GroupSnapshot 672fa00a-d1fe-4a48-9c85-2bb7a2d79c92: creating.
Sep 18 01:08:08 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:08 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] Group snapshot 672fa00a-d1fe-4a48-9c85-2bb7a2d79c92: creating. {{(pid=84134) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 01:08:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-719012e0-331a-461c-813d-194e79c60eb3" returned: 0 in 0.504s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Lock "cinder-quobyte-719012e0-331a-461c-813d-194e79c60eb3" released by "delete_volume" :: held 1.226s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:08 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] Creating offline snapshot beb70ea0-b79a-4ac7-96f8-40ab9123f463 of volume 018539db-5f90-4cb8-a8f8-dae26b70050a {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:08:08 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33b1a72-a4a8-4d99-ae14-a43da1995082]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:08:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:08 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Created reservations ['762eeafc-e098-4805-bba7-a43c2e42f4af', 'bb03e27c-5c1c-455b-b8b8-7addba8442c9', '8e92d8ae-975e-4cbe-a477-04269fd332e2', '9207ee94-2b72-46bd-98c1-4a5ca9d0c250'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:08:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.135s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:09 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:08:09 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Deleted volume successfully.
Sep 18 01:08:09 devstack quobyte-client[84147]: System call of process 93281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:08:09 devstack quobyte-client[84147]: System call of process 93281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:08:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a" returned: 0 in 1.247s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:10 devstack quobyte-client[84147]: System call of process 93285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:08:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2c418fbf-8a0b-4129-84ed-2cc0d478218c tempest-VolumesActionsTest-1477594842 None] Lock "cinder-719012e0-331a-461c-813d-194e79c60eb3-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:10 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=47, name=volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:08:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463 1G" returned: 0 in 0.472s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img rebase -u -b volume-018539db-5f90-4cb8-a8f8-dae26b70050a -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:10 devstack quobyte-client[84147]: System call of process 93288 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:08:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img rebase -u -b volume-018539db-5f90-4cb8-a8f8-dae26b70050a -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463" returned: 0 in 0.324s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:10 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:08:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463" returned: 0 in 0.240s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:08:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463" returned: 0 in 0.155s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.info" returned: 0 in 0.243s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:08:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.info" returned: 0 in 0.197s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.460s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:12 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-72f9ec8f-be54-4d98-a9f7-2d4608f63051 tempest-GroupSnapshotsTest-1402530406 None] group_snapshot 672fa00a-d1fe-4a48-9c85-2bb7a2d79c92: created successfully
Sep 18 01:08:13 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] group_snapshot 672fa00a-d1fe-4a48-9c85-2bb7a2d79c92: deleting
Sep 18 01:08:13 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] group_snapshot 672fa00a-d1fe-4a48-9c85-2bb7a2d79c92: deleting {{(pid=84134) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 01:08:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-018539db-5f90-4cb8-a8f8-dae26b70050a" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:14 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-018539db-5f90-4cb8-a8f8-dae26b70050a" acquired by "delete_snapshot" :: waited 0.109s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:14 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-beb70ea0-b79a-4ac7-96f8-40ab9123f463" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:14 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-beb70ea0-b79a-4ac7-96f8-40ab9123f463" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Deleting offline snapshot beb70ea0-b79a-4ac7-96f8-40ab9123f463 of volume 018539db-5f90-4cb8-a8f8-dae26b70050a {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:08:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] snapshot_file for this snap is: volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:08:14 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[59135fbb-dc71-4c63-a7a2-3b6219e7bdbf]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:08:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463" returned: 0 in 0.533s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-018539db-5f90-4cb8-a8f8-dae26b70050a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:08:14 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[94af7116-8510-4414-99cf-04717ef683fa]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:08:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a" returned: 0 in 0.728s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:15 devstack quobyte-client[84147]: System call of process 93302 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:08:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463" returned: 0 in 0.295s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a.beb70ea0-b79a-4ac7-96f8-40ab9123f463" returned: 0 in 0.357s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-beb70ea0-b79a-4ac7-96f8-40ab9123f463" released by "_delete_snapshot" :: held 2.487s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-018539db-5f90-4cb8-a8f8-dae26b70050a" released by "delete_snapshot" :: held 2.555s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:17 devstack cinder-volume[84134]: WARNING cinder.quota [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1359564173 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1359564173, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:08:17 devstack cinder-volume[84134]: WARNING cinder.quota [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1359564173 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1359564173, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:08:17 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] Created reservations ['e93247d0-2e84-4b0c-8b52-49240dcb89d1', '70f46ce7-823c-41ee-bfd0-6ba51021294c', 'b56059de-7f74-49e8-bbe3-ce86f876100f', '6339c616-8ec5-43e1-afcf-8823b78aa349'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:08:17 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-151e4c4c-8044-4bf2-996e-28c11091ff8d tempest-GroupSnapshotsTest-1402530406 None] group_snapshot 672fa00a-d1fe-4a48-9c85-2bb7a2d79c92: deleted successfully
Sep 18 01:08:18 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "cinder-quobyte-018539db-5f90-4cb8-a8f8-dae26b70050a" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-018539db-5f90-4cb8-a8f8-dae26b70050a" acquired by "delete_volume" :: waited 0.024s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:19 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[117fae8d-9e4c-4d50-b6c3-0f472f7c0a6b]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:08:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a" returned: 0 in 0.691s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-018539db-5f90-4cb8-a8f8-dae26b70050a" returned: 0 in 0.448s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Lock "cinder-quobyte-018539db-5f90-4cb8-a8f8-dae26b70050a" released by "delete_volume" :: held 1.379s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:20 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Created reservations ['74a727fa-0e95-48ef-8992-0b3e34d13d95'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:08:20 devstack cinder-volume[84134]: WARNING cinder.quota [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1359564173 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1359564173, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:08:20 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Created reservations ['1ff953f1-6db9-4f55-870e-dcd507484fdb', 'd73f1133-28b3-4a24-97da-8b4617faa651', '9ab5582f-3d91-4c1a-b20f-c65ccfef3f1b', '0f76f27b-bec8-42c4-b7ee-baa8f005473b'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:08:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.307s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:21 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:08:21 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8bd78fb3-c4ee-4efa-ac07-fa7a778912dc tempest-GroupSnapshotsTest-1402530406 None] Delete group completed successfully.
Sep 18 01:08:31 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=32,cinder:UPDATE=47,cinder:INSERT=12,cinder:DELETE=3 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:08:31 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=33,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:08:35 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Flow 'volume_create_manager' (1fe8d66f-fb69-44ae-9f25-9c8574806333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c6a282-d33b-4904-8f5c-7a1fa859a1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c6a282-d33b-4904-8f5c-7a1fa859a1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-189132359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41902e1-ac3f-4610-9b5e-46aa46aec3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bff8ca4a9584fceb570577133c92dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:08:35Z,use_quota=True,user_id='ef8f631f34884b7399249f4ba5cbc1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91074622-4aed-4b0f-9e2a-073cb4487f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91074622-4aed-4b0f-9e2a-073cb4487f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e107b6f-4900-461b-a6c0-9263a61e1fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e107b6f-4900-461b-a6c0-9263a61e1fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b41902e1-ac3f-4610-9b5e-46aa46aec3e5', 'volume_name': 'volume-b41902e1-ac3f-4610-9b5e-46aa46aec3e5', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0322481f-34ce-44d7-a65e-6177531e3401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0322481f-34ce-44d7-a65e-6177531e3401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4289a18c-a9b7-4f03-a0a2-7d417168366e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:35 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Volume b41902e1-ac3f-4610-9b5e-46aa46aec3e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b41902e1-ac3f-4610-9b5e-46aa46aec3e5', 'volume_size': 1}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-189132359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41902e1-ac3f-4610-9b5e-46aa46aec3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bff8ca4a9584fceb570577133c92dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:08:35Z,use_quota=True,user_id='ef8f631f34884b7399249f4ba5cbc1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Creating volume b41902e1-ac3f-4610-9b5e-46aa46aec3e5 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:08:35 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:08:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b41902e1-ac3f-4610-9b5e-46aa46aec3e5 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:36 devstack quobyte-client[84147]: System call of process 93347 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:08:36 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=49, name=volume-b41902e1-ac3f-4610-9b5e-46aa46aec3e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:08:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b41902e1-ac3f-4610-9b5e-46aa46aec3e5 1073741824" returned: 0 in 0.339s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b41902e1-ac3f-4610-9b5e-46aa46aec3e5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b41902e1-ac3f-4610-9b5e-46aa46aec3e5" returned: 0 in 0.101s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:36 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] <== create_volume: return (520ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:08:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.534s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4289a18c-a9b7-4f03-a0a2-7d417168366e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b41902e1-ac3f-4610-9b5e-46aa46aec3e5', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e070530c-aeb3-4ab4-af3f-42d7de6238d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:36 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Volume volume-b41902e1-ac3f-4610-9b5e-46aa46aec3e5 (b41902e1-ac3f-4610-9b5e-46aa46aec3e5): created successfully
Sep 18 01:08:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e070530c-aeb3-4ab4-af3f-42d7de6238d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Flow 'volume_create_manager' (1fe8d66f-fb69-44ae-9f25-9c8574806333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:08:36 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-65cf960a-709f-4600-a69e-12b7222a1e66 tempest-VolumesListAdminTestJSON-800100884 None] Created volume successfully.
Sep 18 01:08:38 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Flow 'volume_create_manager' (7405a9c9-d6b2-4fce-826e-d4161890c990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a32695-977f-4cb3-a915-d8186baeaa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a32695-977f-4cb3-a915-d8186baeaa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-333469309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1918924-b50f-4754-9eec-76d20d4b41c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bff8ca4a9584fceb570577133c92dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:08:38Z,use_quota=True,user_id='ef8f631f34884b7399249f4ba5cbc1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5abc25-df3d-4ba0-a2dc-5e58d775f8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5abc25-df3d-4ba0-a2dc-5e58d775f8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415d8a74-10eb-440c-b75d-9beaeabed04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415d8a74-10eb-440c-b75d-9beaeabed04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1918924-b50f-4754-9eec-76d20d4b41c2', 'volume_name': 'volume-d1918924-b50f-4754-9eec-76d20d4b41c2', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (550effae-4f48-4a1c-b343-8252a6b62db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (550effae-4f48-4a1c-b343-8252a6b62db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f786554f-0521-4f28-9247-a9cab5047b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:38 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Volume d1918924-b50f-4754-9eec-76d20d4b41c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1918924-b50f-4754-9eec-76d20d4b41c2', 'volume_size': 1}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-333469309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1918924-b50f-4754-9eec-76d20d4b41c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bff8ca4a9584fceb570577133c92dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:08:38Z,use_quota=True,user_id='ef8f631f34884b7399249f4ba5cbc1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Creating volume d1918924-b50f-4754-9eec-76d20d4b41c2 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:08:38 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d1918924-b50f-4754-9eec-76d20d4b41c2 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:38 devstack quobyte-client[84147]: System call of process 93351 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:08:38 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=50, name=volume-d1918924-b50f-4754-9eec-76d20d4b41c2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d1918924-b50f-4754-9eec-76d20d4b41c2 1073741824" returned: 0 in 0.390s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d1918924-b50f-4754-9eec-76d20d4b41c2 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d1918924-b50f-4754-9eec-76d20d4b41c2" returned: 0 in 0.090s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] <== create_volume: return (551ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:08:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.563s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f786554f-0521-4f28-9247-a9cab5047b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1918924-b50f-4754-9eec-76d20d4b41c2', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a22664-e97b-404a-9c37-6789c8a8d21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:39 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Volume volume-d1918924-b50f-4754-9eec-76d20d4b41c2 (d1918924-b50f-4754-9eec-76d20d4b41c2): created successfully
Sep 18 01:08:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a22664-e97b-404a-9c37-6789c8a8d21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Flow 'volume_create_manager' (7405a9c9-d6b2-4fce-826e-d4161890c990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:08:39 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-1f29a4a8-7951-497b-87e2-c19260118e04 tempest-VolumesListAdminTestJSON-800100884 None] Created volume successfully.
Sep 18 01:08:40 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:40 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:08:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Flow 'volume_create_manager' (9cdcc000-c2d7-4afd-aa87-27b5035ed533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:08:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea4f1fc-118b-4491-8546-6ea73a7632cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea4f1fc-118b-4491-8546-6ea73a7632cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1241684568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21cd7bda-b693-41ff-8758-d7de83f5924f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bff8ca4a9584fceb570577133c92dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:08:41Z,use_quota=True,user_id='ef8f631f34884b7399249f4ba5cbc1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c4e4c4-26a2-475d-af35-0933d8219807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c4e4c4-26a2-475d-af35-0933d8219807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca61da1-b278-4e33-b149-08ff7a716a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca61da1-b278-4e33-b149-08ff7a716a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21cd7bda-b693-41ff-8758-d7de83f5924f', 'volume_name': 'volume-21cd7bda-b693-41ff-8758-d7de83f5924f', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfefa11c-29c3-4fc0-a95a-b92fef9d33a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfefa11c-29c3-4fc0-a95a-b92fef9d33a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8891608-fbde-46a5-a7fc-b69c4d9a27b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:41 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Volume 21cd7bda-b693-41ff-8758-d7de83f5924f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21cd7bda-b693-41ff-8758-d7de83f5924f', 'volume_size': 1}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1241684568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21cd7bda-b693-41ff-8758-d7de83f5924f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bff8ca4a9584fceb570577133c92dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:08:41Z,use_quota=True,user_id='ef8f631f34884b7399249f4ba5cbc1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Creating volume 21cd7bda-b693-41ff-8758-d7de83f5924f {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:08:41 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-21cd7bda-b693-41ff-8758-d7de83f5924f 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:41 devstack quobyte-client[84147]: System call of process 93356 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:08:41 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=51, name=volume-21cd7bda-b693-41ff-8758-d7de83f5924f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-21cd7bda-b693-41ff-8758-d7de83f5924f 1073741824" returned: 0 in 0.393s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-21cd7bda-b693-41ff-8758-d7de83f5924f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-21cd7bda-b693-41ff-8758-d7de83f5924f" returned: 0 in 0.105s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] <== create_volume: return (579ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.592s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8891608-fbde-46a5-a7fc-b69c4d9a27b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21cd7bda-b693-41ff-8758-d7de83f5924f', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fd0c75-d8ba-4488-9764-506d339a285e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:41 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Volume volume-21cd7bda-b693-41ff-8758-d7de83f5924f (21cd7bda-b693-41ff-8758-d7de83f5924f): created successfully
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fd0c75-d8ba-4488-9764-506d339a285e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Flow 'volume_create_manager' (9cdcc000-c2d7-4afd-aa87-27b5035ed533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:08:42 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b3e683e1-0b45-4718-9a73-6e4fed48568f tempest-VolumesListAdminTestJSON-800100884 None] Created volume successfully.
Sep 18 01:08:44 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Flow 'volume_create_manager' (0de793aa-ca73-4b95-8534-da78be4cb756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fc8137-55c8-44fc-8630-d32f0d96a3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fc8137-55c8-44fc-8630-d32f0d96a3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794a6783-2b17-4934-8cde-89ac477276c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb661229fac64fb294374441ec2d77db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:08:44Z,use_quota=True,user_id='671c5874a4944f658cc5eac2be8ed1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d017c0c-aef5-47d4-b0aa-dee99ced6cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d017c0c-aef5-47d4-b0aa-dee99ced6cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26ed7f8-e7ab-4de1-906e-29e40ba9a788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26ed7f8-e7ab-4de1-906e-29e40ba9a788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794a6783-2b17-4934-8cde-89ac477276c3', 'volume_name': 'volume-794a6783-2b17-4934-8cde-89ac477276c3', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ab576f-db64-4475-9854-39f025bd374d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ab576f-db64-4475-9854-39f025bd374d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8005a44f-b920-47c3-8d84-18e02b115cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:44 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Volume 794a6783-2b17-4934-8cde-89ac477276c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794a6783-2b17-4934-8cde-89ac477276c3', 'volume_size': 1}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794a6783-2b17-4934-8cde-89ac477276c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb661229fac64fb294374441ec2d77db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:08:44Z,use_quota=True,user_id='671c5874a4944f658cc5eac2be8ed1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Creating volume 794a6783-2b17-4934-8cde-89ac477276c3 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:08:44 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:08:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-794a6783-2b17-4934-8cde-89ac477276c3 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:44 devstack quobyte-client[84147]: System call of process 93365 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:08:44 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=52, name=volume-794a6783-2b17-4934-8cde-89ac477276c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:08:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-794a6783-2b17-4934-8cde-89ac477276c3 1073741824" returned: 0 in 0.383s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-794a6783-2b17-4934-8cde-89ac477276c3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-794a6783-2b17-4934-8cde-89ac477276c3" returned: 0 in 0.291s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] <== create_volume: return (789ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:08:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:45 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8005a44f-b920-47c3-8d84-18e02b115cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794a6783-2b17-4934-8cde-89ac477276c3', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915c2716-c047-4d44-b191-14de3284c7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:46 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Volume volume-794a6783-2b17-4934-8cde-89ac477276c3 (794a6783-2b17-4934-8cde-89ac477276c3): created successfully
Sep 18 01:08:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915c2716-c047-4d44-b191-14de3284c7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Flow 'volume_create_manager' (0de793aa-ca73-4b95-8534-da78be4cb756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:08:46 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-db9d02a7-52a4-44c7-9708-b1af99d39528 tempest-VolumesListAdminTestJSON-924410160 None] Created volume successfully.
Sep 18 01:08:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Acquiring lock "cinder-794a6783-2b17-4934-8cde-89ac477276c3-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Lock "cinder-794a6783-2b17-4934-8cde-89ac477276c3-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:47 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Acquiring lock "cinder-quobyte-794a6783-2b17-4934-8cde-89ac477276c3" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "cinder-21cd7bda-b693-41ff-8758-d7de83f5924f-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Lock "cinder-21cd7bda-b693-41ff-8758-d7de83f5924f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Lock "cinder-quobyte-794a6783-2b17-4934-8cde-89ac477276c3" acquired by "delete_volume" :: waited 0.036s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:47 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "cinder-quobyte-21cd7bda-b693-41ff-8758-d7de83f5924f" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:47 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb7ef90-1a56-4d5e-bc4b-4757e8c4687d]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:08:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-794a6783-2b17-4934-8cde-89ac477276c3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:48 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Lock "cinder-quobyte-21cd7bda-b693-41ff-8758-d7de83f5924f" acquired by "delete_volume" :: waited 0.333s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:48 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ace67dd-e256-4f67-ba2e-1bf53a96276f]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:08:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-21cd7bda-b693-41ff-8758-d7de83f5924f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:48 devstack quobyte-client[84147]: System call of process 93383 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:08:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-794a6783-2b17-4934-8cde-89ac477276c3" returned: 0 in 1.424s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-794a6783-2b17-4934-8cde-89ac477276c3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-21cd7bda-b693-41ff-8758-d7de83f5924f" returned: 0 in 1.350s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-794a6783-2b17-4934-8cde-89ac477276c3" returned: 0 in 0.414s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-21cd7bda-b693-41ff-8758-d7de83f5924f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Lock "cinder-quobyte-794a6783-2b17-4934-8cde-89ac477276c3" released by "delete_volume" :: held 2.578s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-21cd7bda-b693-41ff-8758-d7de83f5924f" returned: 0 in 0.917s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Lock "cinder-quobyte-21cd7bda-b693-41ff-8758-d7de83f5924f" released by "delete_volume" :: held 2.735s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:50 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Created reservations ['8fd60bcc-637a-4ca6-bc2b-114dae02625f', '3329d6f9-fcbc-4d5f-a4c9-c4c52ef069b7', 'cd95f5e3-d9c8-4c42-9ef2-6772fdc5e975', '0a814ed8-1373-4ed2-9b66-a4f71ab4e542'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:08:51 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Created reservations ['c2e732d7-8092-4fcb-a660-017195b2defb', '1519efe1-cbe9-414a-8d3f-94c56e149807', 'b506c8c0-4287-47a7-ac82-4fa244d5e11f', '9de27946-81ce-41ce-a42b-07b19c76c659'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:08:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.399s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:51 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:08:51 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Deleted volume successfully.
Sep 18 01:08:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8a2a9ecc-aa5e-4df0-85bf-2a2269a14a03 tempest-VolumesListAdminTestJSON-924410160 None] Lock "cinder-794a6783-2b17-4934-8cde-89ac477276c3-delete_volume" released by "delete_volume" :: held 4.932s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.128s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:52 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:08:52 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Deleted volume successfully.
Sep 18 01:08:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "cinder-d1918924-b50f-4754-9eec-76d20d4b41c2-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1bf4956f-6770-4664-93bd-91357a665588 tempest-VolumesListAdminTestJSON-800100884 None] Lock "cinder-21cd7bda-b693-41ff-8758-d7de83f5924f-delete_volume" released by "delete_volume" :: held 5.319s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Lock "cinder-d1918924-b50f-4754-9eec-76d20d4b41c2-delete_volume" acquired by "delete_volume" :: waited 0.187s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:53 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "cinder-quobyte-d1918924-b50f-4754-9eec-76d20d4b41c2" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Lock "cinder-quobyte-d1918924-b50f-4754-9eec-76d20d4b41c2" acquired by "delete_volume" :: waited 0.036s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:53 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f064447-0ecc-4c0f-a565-b59a79f9323a]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:08:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d1918924-b50f-4754-9eec-76d20d4b41c2 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d1918924-b50f-4754-9eec-76d20d4b41c2" returned: 0 in 0.829s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d1918924-b50f-4754-9eec-76d20d4b41c2 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d1918924-b50f-4754-9eec-76d20d4b41c2" returned: 0 in 0.134s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Lock "cinder-quobyte-d1918924-b50f-4754-9eec-76d20d4b41c2" released by "delete_volume" :: held 1.242s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:54 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Created reservations ['5e7e2c11-c372-4601-9da6-5f437225cde0', '9a791ec6-327f-4db7-b99b-11a1456a6be2', 'd7f05f44-226a-4415-b3f1-9ec530ada6e4', '682f4a0f-197e-415e-89dd-d2a798dc0cb3'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:08:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.159s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:55 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:08:55 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Deleted volume successfully.
Sep 18 01:08:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "cinder-b41902e1-ac3f-4610-9b5e-46aa46aec3e5-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2ca452a9-e920-440a-9d0c-0d03257f8159 tempest-VolumesListAdminTestJSON-800100884 None] Lock "cinder-d1918924-b50f-4754-9eec-76d20d4b41c2-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Lock "cinder-b41902e1-ac3f-4610-9b5e-46aa46aec3e5-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:55 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "cinder-quobyte-b41902e1-ac3f-4610-9b5e-46aa46aec3e5" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:08:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Lock "cinder-quobyte-b41902e1-ac3f-4610-9b5e-46aa46aec3e5" acquired by "delete_volume" :: waited 0.009s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:08:55 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d99a86d-2378-4aac-8699-6672433c19dd]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:08:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b41902e1-ac3f-4610-9b5e-46aa46aec3e5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b41902e1-ac3f-4610-9b5e-46aa46aec3e5" returned: 0 in 0.620s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b41902e1-ac3f-4610-9b5e-46aa46aec3e5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b41902e1-ac3f-4610-9b5e-46aa46aec3e5" returned: 0 in 0.133s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:08:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Lock "cinder-quobyte-b41902e1-ac3f-4610-9b5e-46aa46aec3e5" released by "delete_volume" :: held 1.165s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.414s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:08:57 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Created reservations ['e41ecf76-a2bf-41e0-a7be-aa9a4dd1160b', 'baf69fd5-cf29-468e-aa89-bfc188c38188', '4272b1f8-3d6f-4e84-850d-f819ef60d1b6', '7103c907-84a5-47c1-9e73-dacb3d584453'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:08:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.131s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:08:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:08:58 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Deleted volume successfully.
Sep 18 01:08:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3c98d26f-7085-4638-9e38-9b0d66438d54 tempest-VolumesListAdminTestJSON-800100884 None] Lock "cinder-b41902e1-ac3f-4610-9b5e-46aa46aec3e5-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:08:59 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Flow 'volume_create_manager' (20e1588a-e541-4c4c-94a0-2a80fe83d2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73a2eac-5081-4c20-9124-2aae1298b01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73a2eac-5081-4c20-9124-2aae1298b01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1408473953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df89cce-b4c4-4648-9ded-02b0d64331d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3aae1d33af4c3a886e20b3754b6098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:08:59Z,use_quota=True,user_id='99b1e8e342af4fb6a5611a1dd2f4bce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7935308-9832-4d4d-843a-651b2fd54ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7935308-9832-4d4d-843a-651b2fd54ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984602c8-55fb-4e19-9afb-c96f5802a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984602c8-55fb-4e19-9afb-c96f5802a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df89cce-b4c4-4648-9ded-02b0d64331d4', 'volume_name': 'volume-8df89cce-b4c4-4648-9ded-02b0d64331d4', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b321fe-2ded-45bf-b09b-9a06efd94eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b321fe-2ded-45bf-b09b-9a06efd94eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fce2f31-07b4-4321-afef-b1d786678d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:08:59 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Volume 8df89cce-b4c4-4648-9ded-02b0d64331d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df89cce-b4c4-4648-9ded-02b0d64331d4', 'volume_size': 1}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1408473953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df89cce-b4c4-4648-9ded-02b0d64331d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3aae1d33af4c3a886e20b3754b6098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:08:59Z,use_quota=True,user_id='99b1e8e342af4fb6a5611a1dd2f4bce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Creating volume 8df89cce-b4c4-4648-9ded-02b0d64331d4 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:08:59 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:08:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8df89cce-b4c4-4648-9ded-02b0d64331d4 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:08:59 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=53, name=volume-8df89cce-b4c4-4648-9ded-02b0d64331d4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:09:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8df89cce-b4c4-4648-9ded-02b0d64331d4 1073741824" returned: 0 in 0.425s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8df89cce-b4c4-4648-9ded-02b0d64331d4 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8df89cce-b4c4-4648-9ded-02b0d64331d4" returned: 0 in 0.208s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] <== create_volume: return (723ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:09:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fce2f31-07b4-4321-afef-b1d786678d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df89cce-b4c4-4648-9ded-02b0d64331d4', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c565c12d-d3e6-41e6-b7e7-5f1e22091555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:00 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Volume volume-8df89cce-b4c4-4648-9ded-02b0d64331d4 (8df89cce-b4c4-4648-9ded-02b0d64331d4): created successfully
Sep 18 01:09:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c565c12d-d3e6-41e6-b7e7-5f1e22091555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Flow 'volume_create_manager' (20e1588a-e541-4c4c-94a0-2a80fe83d2ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:09:00 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-37434ece-b9fd-4727-bd4f-1806b20a62c1 tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Created volume successfully.
Sep 18 01:09:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Acquiring lock "cinder-8df89cce-b4c4-4648-9ded-02b0d64331d4-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Lock "cinder-8df89cce-b4c4-4648-9ded-02b0d64331d4-delete_volume" acquired by "delete_volume" :: waited 0.227s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:04 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Acquiring lock "cinder-quobyte-8df89cce-b4c4-4648-9ded-02b0d64331d4" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Lock "cinder-quobyte-8df89cce-b4c4-4648-9ded-02b0d64331d4" acquired by "delete_volume" :: waited 0.020s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:04 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b334804a-69ce-4699-9fac-6ff50de2925f]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8df89cce-b4c4-4648-9ded-02b0d64331d4 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8df89cce-b4c4-4648-9ded-02b0d64331d4" returned: 0 in 1.101s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8df89cce-b4c4-4648-9ded-02b0d64331d4 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8df89cce-b4c4-4648-9ded-02b0d64331d4" returned: 0 in 0.208s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Lock "cinder-quobyte-8df89cce-b4c4-4648-9ded-02b0d64331d4" released by "delete_volume" :: held 1.863s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:06 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Created reservations ['2ab76a1b-4e61-4636-b4da-cac426f81233', '7d8b639d-4945-4824-a4d8-8702a1a80112', '128738d5-9927-4559-9fe8-3d6d7f45930c', '0296032b-08db-4854-b140-2f9936d6556c'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:09:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:09:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:09:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.233s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:07 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:09:08 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Deleted volume successfully.
Sep 18 01:09:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5360b47d-a147-4450-8420-c493b3cd659a tempest-VolumeQuotasNegativeTestJSON-2077608090 None] Lock "cinder-8df89cce-b4c4-4648-9ded-02b0d64331d4-delete_volume" released by "delete_volume" :: held 4.745s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:12 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Flow 'volume_create_manager' (23d28708-d42a-4db7-9910-7815c33d7116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598812bc-7d12-4778-89c7-935a7d9d57fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598812bc-7d12-4778-89c7-935a7d9d57fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1016512120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cb54d3-6f1d-4f98-97d1-2fcda0747a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f34894b73dc435dae46b26600645761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:09:13Z,use_quota=True,user_id='e6fb415d883149859541c4e4a3cce778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdca9416-d9ff-4f40-9893-fb43e485a74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdca9416-d9ff-4f40-9893-fb43e485a74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fe05dc-5941-417a-9745-ba06535cd982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fe05dc-5941-417a-9745-ba06535cd982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69cb54d3-6f1d-4f98-97d1-2fcda0747a48', 'volume_name': 'volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788c5265-d537-4a02-88fb-2cb801a17d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788c5265-d537-4a02-88fb-2cb801a17d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b02c54d-ddd6-4283-85ef-434e6a8e5566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:13 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Volume 69cb54d3-6f1d-4f98-97d1-2fcda0747a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48', 'volume_size': 1}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1016512120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cb54d3-6f1d-4f98-97d1-2fcda0747a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f34894b73dc435dae46b26600645761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:09:13Z,use_quota=True,user_id='e6fb415d883149859541c4e4a3cce778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Creating volume 69cb54d3-6f1d-4f98-97d1-2fcda0747a48 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:09:13 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:13 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=54, name=volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:09:13 devstack quobyte-client[84147]: System call of process 93517 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48 1073741824" returned: 0 in 0.409s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48" returned: 0 in 0.148s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] <== create_volume: return (637ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:09:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.651s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b02c54d-ddd6-4283-85ef-434e6a8e5566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03887529-8268-40b4-9970-fe784f96be38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:14 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Volume volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48 (69cb54d3-6f1d-4f98-97d1-2fcda0747a48): created successfully
Sep 18 01:09:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03887529-8268-40b4-9970-fe784f96be38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Flow 'volume_create_manager' (23d28708-d42a-4db7-9910-7815c33d7116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:09:14 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-cf385ede-d143-4f02-af9c-f91318517582 tempest-SnapshotMetadataTestJSON-1902023489 None] Created volume successfully.
Sep 18 01:09:14 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:14 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Flow 'volume_create_manager' (ad60035e-ae9c-4e82-8f09-8e85d0950e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c30c648-ab8c-469c-a33e-d70fd05bc134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c30c648-ab8c-469c-a33e-d70fd05bc134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1684961110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00da4b79-a062-4f92-a3ef-024318611a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983d6186a2e2486a87dbbf2c7446b41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:09:15Z,use_quota=True,user_id='221b39ce76194d62817cc3f9ab274f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd57f823-19e7-434b-877b-e69739637b5f),volume_type_id=bd57f823-19e7-434b-877b-e69739637b5f)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0d58b4-5e14-4184-915a-53d3c0a8a550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0d58b4-5e14-4184-915a-53d3c0a8a550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81035043-e115-455c-82d6-5c624a0fb0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81035043-e115-455c-82d6-5c624a0fb0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00da4b79-a062-4f92-a3ef-024318611a42', 'volume_name': 'volume-00da4b79-a062-4f92-a3ef-024318611a42', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030b0334-8bb5-4b7c-bc8f-7d98f2ebc609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030b0334-8bb5-4b7c-bc8f-7d98f2ebc609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdaf5bf-4068-4314-b440-f067fd9c0788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:15 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Volume 00da4b79-a062-4f92-a3ef-024318611a42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00da4b79-a062-4f92-a3ef-024318611a42', 'volume_size': 1}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1684961110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00da4b79-a062-4f92-a3ef-024318611a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983d6186a2e2486a87dbbf2c7446b41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:09:15Z,use_quota=True,user_id='221b39ce76194d62817cc3f9ab274f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd57f823-19e7-434b-877b-e69739637b5f),volume_type_id=bd57f823-19e7-434b-877b-e69739637b5f)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Creating volume 00da4b79-a062-4f92-a3ef-024318611a42 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:09:15 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-00da4b79-a062-4f92-a3ef-024318611a42 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:15 devstack quobyte-client[84147]: System call of process 93521 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:09:15 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=55, name=volume-00da4b79-a062-4f92-a3ef-024318611a42, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-00da4b79-a062-4f92-a3ef-024318611a42 1073741824" returned: 0 in 0.645s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-00da4b79-a062-4f92-a3ef-024318611a42 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:16 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-00da4b79-a062-4f92-a3ef-024318611a42" returned: 0 in 0.346s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:16 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] <== create_volume: return (1049ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:09:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.073s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:16 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdaf5bf-4068-4314-b440-f067fd9c0788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00da4b79-a062-4f92-a3ef-024318611a42', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:16 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf6010e-0a68-4982-aaf0-73e2fdb58b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:16 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] Creating offline snapshot 566089c4-a167-4fbd-b35a-2d632093c2c8 of volume 69cb54d3-6f1d-4f98-97d1-2fcda0747a48 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:09:16 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac26ae8d-c149-4f85-af6b-4f19e37bc4d8]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:16 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Volume volume-00da4b79-a062-4f92-a3ef-024318611a42 (00da4b79-a062-4f92-a3ef-024318611a42): created successfully
Sep 18 01:09:16 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf6010e-0a68-4982-aaf0-73e2fdb58b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:16 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Flow 'volume_create_manager' (ad60035e-ae9c-4e82-8f09-8e85d0950e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:09:16 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-385aa475-3f9e-4f47-8b1e-706fa5aa9684 tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Created volume successfully.
Sep 18 01:09:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48" returned: 0 in 0.499s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:17 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=56, name=volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:09:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8 1G" returned: 0 in 0.226s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): qemu-img rebase -u -b volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "qemu-img rebase -u -b volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8" returned: 0 in 0.172s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:09:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:17 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-a207a8c8-9203-49d6-9212-1373a3472cac tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8" returned: 0 in 0.451s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:09:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8" returned: 0 in 0.265s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.info" returned: 0 in 0.283s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:18 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:09:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.info" returned: 0 in 0.420s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.668s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:19 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b226d9c1-977c-418f-9b6f-b71a6703c37d tempest-SnapshotMetadataTestJSON-1902023489 None] Create snapshot completed successfully
Sep 18 01:09:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a207a8c8-9203-49d6-9212-1373a3472cac tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a207a8c8-9203-49d6-9212-1373a3472cac tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:19 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a207a8c8-9203-49d6-9212-1373a3472cac tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:09:19 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a207a8c8-9203-49d6-9212-1373a3472cac tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:09:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a207a8c8-9203-49d6-9212-1373a3472cac tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a207a8c8-9203-49d6-9212-1373a3472cac tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Acquiring lock "cinder-00da4b79-a062-4f92-a3ef-024318611a42-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a207a8c8-9203-49d6-9212-1373a3472cac tempest-VolumeRetypeWithoutMigrationTest-542362390 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.258s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:19 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-a207a8c8-9203-49d6-9212-1373a3472cac tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:09:19 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-a207a8c8-9203-49d6-9212-1373a3472cac tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Retype volume completed successfully.
Sep 18 01:09:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Lock "cinder-00da4b79-a062-4f92-a3ef-024318611a42-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:19 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Acquiring lock "cinder-quobyte-00da4b79-a062-4f92-a3ef-024318611a42" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Lock "cinder-quobyte-00da4b79-a062-4f92-a3ef-024318611a42" acquired by "delete_volume" :: waited 0.017s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:19 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[28572d60-631d-4c06-a6fb-524ad28d8805]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-00da4b79-a062-4f92-a3ef-024318611a42 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-00da4b79-a062-4f92-a3ef-024318611a42" returned: 0 in 0.535s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-00da4b79-a062-4f92-a3ef-024318611a42 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-00da4b79-a062-4f92-a3ef-024318611a42" returned: 0 in 0.159s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Lock "cinder-quobyte-00da4b79-a062-4f92-a3ef-024318611a42" released by "delete_volume" :: held 0.873s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:20 devstack cinder-volume[84134]: WARNING cinder.quota [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:09:20 devstack cinder-volume[84134]: WARNING cinder.quota [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:09:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Acquiring lock "cinder-566089c4-a167-4fbd-b35a-2d632093c2c8-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:20 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Created reservations ['f778af52-8ca4-4b47-9c95-bf81e73085e4', '3cdbc3c3-a732-40dd-9649-bcc55bdc4f36', '6d179766-4d1b-4b45-856b-d00291076c9b', '8ed11c9e-cb98-4ff1-aee5-8245c49fc13d'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:09:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "cinder-566089c4-a167-4fbd-b35a-2d632093c2c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:20 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Acquiring lock "cinder-quobyte-69cb54d3-6f1d-4f98-97d1-2fcda0747a48" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "cinder-quobyte-69cb54d3-6f1d-4f98-97d1-2fcda0747a48" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Acquiring lock "cinder-quobyte-566089c4-a167-4fbd-b35a-2d632093c2c8" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "cinder-quobyte-566089c4-a167-4fbd-b35a-2d632093c2c8" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Deleting offline snapshot 566089c4-a167-4fbd-b35a-2d632093c2c8 of volume 69cb54d3-6f1d-4f98-97d1-2fcda0747a48 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] snapshot_file for this snap is: volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9511204-6251-4171-8df7-4ba7aeb0bcd0]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.159s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:09:21 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Deleted volume successfully.
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8" returned: 0 in 0.828s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ab02c5-1613-4844-8e96-071be181269e]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:22 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-46d87636-cd65-44bd-93b9-d2b1c170408c tempest-VolumeRetypeWithoutMigrationTest-542362390 None] Lock "cinder-00da4b79-a062-4f92-a3ef-024318611a42-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48" returned: 0 in 0.582s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8" returned: 0 in 0.243s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48.566089c4-a167-4fbd-b35a-2d632093c2c8" returned: 0 in 0.157s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:23 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "cinder-quobyte-566089c4-a167-4fbd-b35a-2d632093c2c8" released by "_delete_snapshot" :: held 2.115s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:23 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "cinder-quobyte-69cb54d3-6f1d-4f98-97d1-2fcda0747a48" released by "delete_snapshot" :: held 2.158s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:23 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Created reservations ['1e0e18c2-c9ef-47f3-bea1-b7635ff09e8c', '0b8e1563-b2ae-43c2-a879-fb27fe85dcc3', '2bcd363c-0c31-4909-b554-c5513c08e1f8', '09f6bea2-1f6d-4f75-bca3-dcddddf7aed2'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:09:23 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Delete snapshot completed successfully.
Sep 18 01:09:23 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e179b5d8-65c8-4031-8e49-7999b3076b2f tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "cinder-566089c4-a167-4fbd-b35a-2d632093c2c8-delete_snapshot" released by "delete_snapshot" :: held 2.671s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Acquiring lock "cinder-69cb54d3-6f1d-4f98-97d1-2fcda0747a48-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "cinder-69cb54d3-6f1d-4f98-97d1-2fcda0747a48-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:24 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Acquiring lock "cinder-quobyte-69cb54d3-6f1d-4f98-97d1-2fcda0747a48" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "cinder-quobyte-69cb54d3-6f1d-4f98-97d1-2fcda0747a48" acquired by "delete_volume" :: waited 0.022s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:24 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e827dd5-71c5-4b3a-ba2b-c0b53b730d42]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48" returned: 0 in 0.438s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69cb54d3-6f1d-4f98-97d1-2fcda0747a48" returned: 0 in 0.136s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:25 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "cinder-quobyte-69cb54d3-6f1d-4f98-97d1-2fcda0747a48" released by "delete_volume" :: held 0.734s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:25 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Created reservations ['6fec1185-4c2c-4e96-8eb4-afb797f5369d', 'f11f407c-246d-4d45-b7b5-d0f97a7be533', '293b14da-1730-459f-9e73-f279a4ff0c13', 'df8a519f-4071-4098-9579-59faef0bc504'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:09:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:09:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:09:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.099s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:25 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:09:25 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Deleted volume successfully.
Sep 18 01:09:26 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-54a6fe0c-9ce1-47ee-84c6-a9b04f105cab tempest-SnapshotMetadataTestJSON-1902023489 None] Lock "cinder-69cb54d3-6f1d-4f98-97d1-2fcda0747a48-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:30 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Flow 'volume_create_manager' (f8233510-598a-4562-aab6-bd7158e67895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce0c635-e671-48f2-bebe-9726aca1b350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce0c635-e671-48f2-bebe-9726aca1b350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1890019317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41fbad1-b0e0-43aa-a894-add7e084e414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba90b7333404027b2f08c12a73166af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:09:30Z,use_quota=True,user_id='0670c60da7d94f538ef8bac4e4be88c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0534d0c-2960-417d-b2bf-9c444937346c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0534d0c-2960-417d-b2bf-9c444937346c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1243faf4-6c54-4784-aa6d-930908dfa0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1243faf4-6c54-4784-aa6d-930908dfa0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f41fbad1-b0e0-43aa-a894-add7e084e414', 'volume_name': 'volume-f41fbad1-b0e0-43aa-a894-add7e084e414', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2867353-54e9-4229-84e7-147f2c3d43f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2867353-54e9-4229-84e7-147f2c3d43f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f887b67b-a9ee-4922-8cdf-538598e274c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:30 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Volume f41fbad1-b0e0-43aa-a894-add7e084e414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f41fbad1-b0e0-43aa-a894-add7e084e414', 'volume_size': 1}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1890019317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41fbad1-b0e0-43aa-a894-add7e084e414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba90b7333404027b2f08c12a73166af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:09:30Z,use_quota=True,user_id='0670c60da7d94f538ef8bac4e4be88c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Creating volume f41fbad1-b0e0-43aa-a894-add7e084e414 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:09:30 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:09:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f41fbad1-b0e0-43aa-a894-add7e084e414 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:30 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=58, name=volume-f41fbad1-b0e0-43aa-a894-add7e084e414, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:09:30 devstack quobyte-client[84147]: System call of process 93571 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:09:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f41fbad1-b0e0-43aa-a894-add7e084e414 1073741824" returned: 0 in 0.353s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f41fbad1-b0e0-43aa-a894-add7e084e414 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f41fbad1-b0e0-43aa-a894-add7e084e414" returned: 0 in 0.106s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] <== create_volume: return (532ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:09:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.545s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:31 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=57,cinder:UPDATE=86,cinder:DELETE=10,cinder:INSERT=21 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:09:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f887b67b-a9ee-4922-8cdf-538598e274c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f41fbad1-b0e0-43aa-a894-add7e084e414', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca94d90-0c18-457f-8f47-0800ae0deb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:31 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=80,cinder:DELETE=5,cinder:SELECT=56,cinder:INSERT=11 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:09:31 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Volume volume-f41fbad1-b0e0-43aa-a894-add7e084e414 (f41fbad1-b0e0-43aa-a894-add7e084e414): created successfully
Sep 18 01:09:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca94d90-0c18-457f-8f47-0800ae0deb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Flow 'volume_create_manager' (f8233510-598a-4562-aab6-bd7158e67895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:09:31 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-f3b8d032-4f70-41cc-b846-f56b99aecf81 tempest-AbsoluteLimitsTests-1605340404 None] Created volume successfully.
Sep 18 01:09:32 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Acquiring lock "cinder-f41fbad1-b0e0-43aa-a894-add7e084e414-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:32 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Lock "cinder-f41fbad1-b0e0-43aa-a894-add7e084e414-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:33 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:33 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Acquiring lock "cinder-quobyte-f41fbad1-b0e0-43aa-a894-add7e084e414" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:33 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Lock "cinder-quobyte-f41fbad1-b0e0-43aa-a894-add7e084e414" acquired by "delete_volume" :: waited 0.019s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:33 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[59194fba-4e95-41a7-be1b-df6657ef903c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f41fbad1-b0e0-43aa-a894-add7e084e414 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f41fbad1-b0e0-43aa-a894-add7e084e414" returned: 0 in 0.477s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f41fbad1-b0e0-43aa-a894-add7e084e414 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f41fbad1-b0e0-43aa-a894-add7e084e414" returned: 0 in 0.100s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:33 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Lock "cinder-quobyte-f41fbad1-b0e0-43aa-a894-add7e084e414" released by "delete_volume" :: held 0.746s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:34 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Created reservations ['5e010c8c-abcf-4e6e-b311-b54a9d5c60b7', '73fb613d-9f6e-4de0-a82b-8fe7c0856162', '9b990b8e-63fb-4b24-8c90-be1fd6b60ea0', '563ed390-98cd-4d30-9328-4893ad24f911'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:09:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:09:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:09:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.113s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:34 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:09:34 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Deleted volume successfully.
Sep 18 01:09:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a7b5b4c2-6c46-4216-b39f-9092b6e5245b tempest-AbsoluteLimitsTests-1605340404 None] Lock "cinder-f41fbad1-b0e0-43aa-a894-add7e084e414-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:36 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-dd7b2a28-53cc-41c4-a11f-c6664491dd14 req-c803b98b-101d-427f-ad29-133669b206c8 tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:36 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-dd7b2a28-53cc-41c4-a11f-c6664491dd14 req-c803b98b-101d-427f-ad29-133669b206c8 tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:36 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-dd7b2a28-53cc-41c4-a11f-c6664491dd14 req-c803b98b-101d-427f-ad29-133669b206c8 tempest-AttachVolumeNegativeTest-1787668276 None] Terminate volume connection completed successfully.
Sep 18 01:09:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-dd7b2a28-53cc-41c4-a11f-c6664491dd14 req-c803b98b-101d-427f-ad29-133669b206c8 tempest-AttachVolumeNegativeTest-1787668276 None] Deleting attachment f759dc06-8eed-4cc9-af05-450ac2c29010. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:09:40 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:40 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Flow 'volume_create_manager' (84227049-4727-4dae-a13b-68c8e8ae45db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0667c38e-e879-46ee-8f2c-14b4aea31168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0667c38e-e879-46ee-8f2c-14b4aea31168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-72749633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b227fa1c-a8de-408c-9886-dffd0f70f574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d8d0f762f14b7abf6239eb6c5f837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:09:41Z,use_quota=True,user_id='aafad12e4a934312ae3032d30198771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f481e541-1647-4126-9aed-bcca2066d7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f481e541-1647-4126-9aed-bcca2066d7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6cc9cf-c3a7-4e70-b5f0-97c526d945ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6cc9cf-c3a7-4e70-b5f0-97c526d945ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b227fa1c-a8de-408c-9886-dffd0f70f574', 'volume_name': 'volume-b227fa1c-a8de-408c-9886-dffd0f70f574', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33fcad8-ab51-4a5e-bbaa-3fad5fad1a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33fcad8-ab51-4a5e-bbaa-3fad5fad1a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2c8e26-b836-4190-a9ad-c0f26d2ce7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:41 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Volume b227fa1c-a8de-408c-9886-dffd0f70f574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b227fa1c-a8de-408c-9886-dffd0f70f574', 'volume_size': 1}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-72749633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b227fa1c-a8de-408c-9886-dffd0f70f574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d8d0f762f14b7abf6239eb6c5f837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:09:41Z,use_quota=True,user_id='aafad12e4a934312ae3032d30198771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Creating volume b227fa1c-a8de-408c-9886-dffd0f70f574 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:09:41 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:41 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=59, name=volume-b227fa1c-a8de-408c-9886-dffd0f70f574, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574 1073741824" returned: 0 in 0.471s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574" returned: 0 in 0.116s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] <== create_volume: return (673ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:09:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2c8e26-b836-4190-a9ad-c0f26d2ce7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b227fa1c-a8de-408c-9886-dffd0f70f574', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fece38d4-8113-4701-a10d-53f32148dcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:42 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Volume volume-b227fa1c-a8de-408c-9886-dffd0f70f574 (b227fa1c-a8de-408c-9886-dffd0f70f574): created successfully
Sep 18 01:09:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fece38d4-8113-4701-a10d-53f32148dcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Flow 'volume_create_manager' (84227049-4727-4dae-a13b-68c8e8ae45db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:09:42 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-da62c418-7035-4276-bca2-1c1f193159ba tempest-VolumesDeleteCascade-7484631 None] Created volume successfully.
Sep 18 01:09:43 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:44 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] Creating offline snapshot f8e8abb9-4cba-41f4-ad78-e27977cb145e of volume b227fa1c-a8de-408c-9886-dffd0f70f574 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:09:44 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[57190ea5-179e-48a7-9958-3d99339be4d2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:45 devstack quobyte-client[84147]: System call of process 93630 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:09:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574" returned: 0 in 1.138s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:45 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=60, name=volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:09:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e 1G" returned: 0 in 0.546s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b227fa1c-a8de-408c-9886-dffd0f70f574 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] CMD "qemu-img rebase -u -b volume-b227fa1c-a8de-408c-9886-dffd0f70f574 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e" returned: 0 in 0.235s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:09:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e" returned: 0 in 0.107s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:09:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e" returned: 0 in 0.158s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.info" returned: 0 in 0.193s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:09:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.info" returned: 0 in 0.080s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.370s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:47 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-0b1cf1c0-9fc2-4efd-92c5-38750daf20c4 tempest-VolumesDeleteCascade-7484631 None] Create snapshot completed successfully
Sep 18 01:09:48 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] Creating offline snapshot 04d66e4a-f9dc-4d9a-83b9-e36f5295667c of volume b227fa1c-a8de-408c-9886-dffd0f70f574 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:09:48 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2ec9b6-7fcc-4be6-8f6e-31eabc68ea85]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e" returned: 0 in 0.448s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b227fa1c-a8de-408c-9886-dffd0f70f574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:09:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:49 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=62, name=volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:09:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c 1G" returned: 0 in 0.297s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] CMD "qemu-img rebase -u -b volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c" returned: 0 in 0.158s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:09:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c" returned: 0 in 0.141s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:09:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c" returned: 0 in 0.182s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.583s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:50 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-1a725d71-b7d4-479c-be9a-7fcf932aed1c tempest-VolumesDeleteCascade-7484631 None] Create snapshot completed successfully
Sep 18 01:09:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-b227fa1c-a8de-408c-9886-dffd0f70f574-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-b227fa1c-a8de-408c-9886-dffd0f70f574-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:50 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Performing cascade delete. {{(pid=84134) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 18 01:09:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-04d66e4a-f9dc-4d9a-83b9-e36f5295667c-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-04d66e4a-f9dc-4d9a-83b9-e36f5295667c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:50 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-quobyte-b227fa1c-a8de-408c-9886-dffd0f70f574" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-b227fa1c-a8de-408c-9886-dffd0f70f574" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-quobyte-04d66e4a-f9dc-4d9a-83b9-e36f5295667c" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-04d66e4a-f9dc-4d9a-83b9-e36f5295667c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Deleting offline snapshot 04d66e4a-f9dc-4d9a-83b9-e36f5295667c of volume b227fa1c-a8de-408c-9886-dffd0f70f574 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:09:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] snapshot_file for this snap is: volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:09:51 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f3ce5c-d181-4aaa-8f21-41f758930d4b]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:51 devstack quobyte-client[84147]: System call of process 93657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:09:51 devstack quobyte-client[84147]: System call of process 93657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c" returned: 0 in 1.041s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b227fa1c-a8de-408c-9886-dffd0f70f574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3399d0f-0e00-4003-8871-3289a43bc950]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:52 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Flow 'volume_create_manager' (b1be1b8e-289a-43e9-b9f7-b048f93d1636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9aa6ec-6963-471f-9d97-1ec5d0caa32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9aa6ec-6963-471f-9d97-1ec5d0caa32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-144048263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028132fc-3ded-4f5f-aa88-85724603efe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95b639e597a4ca7bb87a5dc0caaf04d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:09:52Z,use_quota=True,user_id='9a2dcc1e85c14370a24897bde16da90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88d44df-6a3a-4272-b6f7-2234e4b1e86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88d44df-6a3a-4272-b6f7-2234e4b1e86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (224a93c6-7a67-4f04-8bec-fe361a3ea486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (224a93c6-7a67-4f04-8bec-fe361a3ea486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '028132fc-3ded-4f5f-aa88-85724603efe6', 'volume_name': 'volume-028132fc-3ded-4f5f-aa88-85724603efe6', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bba6691-86eb-4db7-a3e5-66e56a94fcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bba6691-86eb-4db7-a3e5-66e56a94fcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476580b1-5901-4ba8-8235-23a2f2905c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:52 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Volume 028132fc-3ded-4f5f-aa88-85724603efe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-028132fc-3ded-4f5f-aa88-85724603efe6', 'volume_size': 1}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-144048263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028132fc-3ded-4f5f-aa88-85724603efe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95b639e597a4ca7bb87a5dc0caaf04d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:09:52Z,use_quota=True,user_id='9a2dcc1e85c14370a24897bde16da90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Creating volume 028132fc-3ded-4f5f-aa88-85724603efe6 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:09:52 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:09:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-028132fc-3ded-4f5f-aa88-85724603efe6 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e" returned: 0 in 0.856s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:53 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=63, name=volume-028132fc-3ded-4f5f-aa88-85724603efe6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:09:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b227fa1c-a8de-408c-9886-dffd0f70f574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:09:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-028132fc-3ded-4f5f-aa88-85724603efe6 1073741824" returned: 0 in 0.528s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-028132fc-3ded-4f5f-aa88-85724603efe6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-028132fc-3ded-4f5f-aa88-85724603efe6" returned: 0 in 0.208s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] <== create_volume: return (855ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:09:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c" returned: 0 in 0.824s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476580b1-5901-4ba8-8235-23a2f2905c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-028132fc-3ded-4f5f-aa88-85724603efe6', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef03057-f70d-4df1-8418-356879fd8246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:09:54 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Volume volume-028132fc-3ded-4f5f-aa88-85724603efe6 (028132fc-3ded-4f5f-aa88-85724603efe6): created successfully
Sep 18 01:09:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef03057-f70d-4df1-8418-356879fd8246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:09:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Flow 'volume_create_manager' (b1be1b8e-289a-43e9-b9f7-b048f93d1636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:09:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.04d66e4a-f9dc-4d9a-83b9-e36f5295667c" returned: 0 in 0.632s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-04d66e4a-f9dc-4d9a-83b9-e36f5295667c" released by "_delete_snapshot" :: held 3.673s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:54 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-7243c7d2-d128-4dae-b362-bf2582f18ce4 tempest-VolumesTransfersV355Test-963594546 None] Created volume successfully.
Sep 18 01:09:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-b227fa1c-a8de-408c-9886-dffd0f70f574" released by "delete_snapshot" :: held 3.719s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Created reservations ['6dab5933-65a7-471f-89d0-d2086b4341a2', '11ffa075-10ca-462e-ae64-ceb3a330e2b3', '585ab807-dd8d-4ac1-96e0-a9596ba1a0cb', '66f8f109-6c3e-4c1b-922e-6ab7adefe1da'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:09:55 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Delete snapshot completed successfully.
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-04d66e4a-f9dc-4d9a-83b9-e36f5295667c-delete_snapshot" released by "delete_snapshot" :: held 4.221s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-f8e8abb9-4cba-41f4-ad78-e27977cb145e-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-f8e8abb9-4cba-41f4-ad78-e27977cb145e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:55 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-quobyte-b227fa1c-a8de-408c-9886-dffd0f70f574" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-b227fa1c-a8de-408c-9886-dffd0f70f574" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-quobyte-f8e8abb9-4cba-41f4-ad78-e27977cb145e" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-f8e8abb9-4cba-41f4-ad78-e27977cb145e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Deleting offline snapshot f8e8abb9-4cba-41f4-ad78-e27977cb145e of volume b227fa1c-a8de-408c-9886-dffd0f70f574 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] snapshot_file for this snap is: volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a683d5a-f56b-4b4b-9f59-80e41e54e0b7]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:55 devstack quobyte-client[84147]: System call of process 93671 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e" returned: 0 in 0.500s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b227fa1c-a8de-408c-9886-dffd0f70f574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e717776-743d-4ff0-8bb1-9e65fcf9c724]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:56 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-15ce3e89-3abd-4697-a1d5-331b7e282f28 tempest-VolumesTransfersV355Test-1639322633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:56 devstack quobyte-client[84147]: System call of process 93674 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:09:56 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-15ce3e89-3abd-4697-a1d5-331b7e282f28 tempest-VolumesTransfersV355Test-1639322633 None] Transfer volume completed successfully.
Sep 18 01:09:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574" returned: 0 in 0.757s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:09:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:09:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:09:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:09:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:09:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:09:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e" returned: 0 in 0.380s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.341s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:09:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574.f8e8abb9-4cba-41f4-ad78-e27977cb145e" returned: 0 in 0.248s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-f8e8abb9-4cba-41f4-ad78-e27977cb145e" released by "_delete_snapshot" :: held 2.202s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-b227fa1c-a8de-408c-9886-dffd0f70f574" released by "delete_snapshot" :: held 2.226s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:57 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Created reservations ['35aca833-3cea-44f2-81a9-1d80135f0254', '85d31e4a-827c-4033-a80e-44d5e8ee889b', '412b4e26-f36d-48bd-9144-2dcda2f7dd68', '1bd2b0b6-b39d-4ce1-8f79-63ba2d6ef289'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:09:58 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Delete snapshot completed successfully.
Sep 18 01:09:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-f8e8abb9-4cba-41f4-ad78-e27977cb145e-delete_snapshot" released by "delete_snapshot" :: held 2.766s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Snapshots deleted, issuing volume delete {{(pid=84134) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 18 01:09:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-quobyte-b227fa1c-a8de-408c-9886-dffd0f70f574" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Acquiring lock "cinder-028132fc-3ded-4f5f-aa88-85724603efe6-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-b227fa1c-a8de-408c-9886-dffd0f70f574" acquired by "delete_volume" :: waited 0.058s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Lock "cinder-028132fc-3ded-4f5f-aa88-85724603efe6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:58 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[747d212b-18bf-4561-a44d-5de9bda265c7]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:58 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:09:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Acquiring lock "cinder-quobyte-028132fc-3ded-4f5f-aa88-85724603efe6" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:09:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Lock "cinder-quobyte-028132fc-3ded-4f5f-aa88-85724603efe6" acquired by "delete_volume" :: waited 0.069s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:09:58 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f593ede2-7495-4cf2-abaf-c11a2e06cd8b]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:09:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-028132fc-3ded-4f5f-aa88-85724603efe6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574" returned: 0 in 0.705s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:09:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b227fa1c-a8de-408c-9886-dffd0f70f574" returned: 0 in 0.185s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-b227fa1c-a8de-408c-9886-dffd0f70f574" released by "delete_volume" :: held 1.206s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:09:59 devstack quobyte-client[84147]: System call of process 93683 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:09:59 devstack quobyte-client[84147]: System call of process 93683 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:09:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-028132fc-3ded-4f5f-aa88-85724603efe6" returned: 0 in 0.983s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:09:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-028132fc-3ded-4f5f-aa88-85724603efe6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-028132fc-3ded-4f5f-aa88-85724603efe6" returned: 0 in 0.350s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:00 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Created reservations ['de58c7c8-61d6-4f09-91c6-7a113187a9f7', 'b2370b68-6475-4aa5-8dbd-9680ae9b7f20', 'fb6254b4-f3e2-4c56-90ac-a016a167e553', '5077f52b-4351-4663-b283-70cec56ed5a3'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:10:00 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Lock "cinder-quobyte-028132fc-3ded-4f5f-aa88-85724603efe6" released by "delete_volume" :: held 1.661s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:00 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Created reservations ['3a0ef2c9-398b-4b55-94e3-4cdc435b60e8', '80867f4e-b407-42ff-a852-0e0dfe3e5871', '0892b931-f4e3-489b-938e-f8c498cc4ba2', 'e6f9b5e4-6d04-4a58-b3a6-311f1b5201f2'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:10:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.342s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:01 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:10:01 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Deleted volume successfully.
Sep 18 01:10:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cc2a6e3d-760c-45a1-90d7-e5c94edd559e tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-b227fa1c-a8de-408c-9886-dffd0f70f574-delete_volume" released by "delete_volume" :: held 10.466s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.155s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:01 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:10:01 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Deleted volume successfully.
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-716ed0be-829d-4057-bbcd-2cf7afb3b4dc tempest-VolumesTransfersV355Test-1569805090 None] Lock "cinder-028132fc-3ded-4f5f-aa88-85724603efe6-delete_volume" released by "delete_volume" :: held 4.198s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:02 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Flow 'volume_create_manager' (90344dec-121b-4226-895c-acb06c28d9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e11a013-e99c-4841-afdd-68f46af05452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e11a013-e99c-4841-afdd-68f46af05452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2048717543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ca02fb-7cf7-4554-9246-caed3e6addd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d8d0f762f14b7abf6239eb6c5f837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:10:02Z,use_quota=True,user_id='aafad12e4a934312ae3032d30198771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd0ba81-8c78-48bb-ae09-0834975f981f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd0ba81-8c78-48bb-ae09-0834975f981f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b67bdd-bc0a-4973-aa7b-3a463abd2218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b67bdd-bc0a-4973-aa7b-3a463abd2218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0ca02fb-7cf7-4554-9246-caed3e6addd3', 'volume_name': 'volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec38dc2-fb6d-4fad-83ed-633844ac621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec38dc2-fb6d-4fad-83ed-633844ac621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43386a4-b2c1-4771-a83d-c4ee2c7b0a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:02 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Volume f0ca02fb-7cf7-4554-9246-caed3e6addd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3', 'volume_size': 1}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2048717543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ca02fb-7cf7-4554-9246-caed3e6addd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d8d0f762f14b7abf6239eb6c5f837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:10:02Z,use_quota=True,user_id='aafad12e4a934312ae3032d30198771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Creating volume f0ca02fb-7cf7-4554-9246-caed3e6addd3 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:10:02 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:02 devstack quobyte-client[84147]: System call of process 93727 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:10:02 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=64, name=volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:10:02 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:02 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Flow 'volume_create_manager' (eafe531c-9d99-4271-bc66-f6a374e0ca99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af12299-e852-4208-a610-ebc9843ac552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 1073741824" returned: 0 in 0.580s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af12299-e852-4208-a610-ebc9843ac552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1318131556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110d9a90-1318-459b-85e1-eabe283b1056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95b639e597a4ca7bb87a5dc0caaf04d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:10:02Z,use_quota=True,user_id='9a2dcc1e85c14370a24897bde16da90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345deef9-44bd-43e4-bfd5-c68cae6debfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345deef9-44bd-43e4-bfd5-c68cae6debfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1745eecf-671b-4d07-9083-824f8de22b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1745eecf-671b-4d07-9083-824f8de22b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '110d9a90-1318-459b-85e1-eabe283b1056', 'volume_name': 'volume-110d9a90-1318-459b-85e1-eabe283b1056', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a780efe0-961e-4080-b252-f65d9ae49ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a780efe0-961e-4080-b252-f65d9ae49ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637582d7-cf41-4326-bf7f-610d08095ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:03 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Volume 110d9a90-1318-459b-85e1-eabe283b1056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-110d9a90-1318-459b-85e1-eabe283b1056', 'volume_size': 1}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3" returned: 0 in 0.345s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] <== create_volume: return (944ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.100s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1318131556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110d9a90-1318-459b-85e1-eabe283b1056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95b639e597a4ca7bb87a5dc0caaf04d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:10:02Z,use_quota=True,user_id='9a2dcc1e85c14370a24897bde16da90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Creating volume 110d9a90-1318-459b-85e1-eabe283b1056 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:10:03 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-110d9a90-1318-459b-85e1-eabe283b1056 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:03 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=65, name=volume-110d9a90-1318-459b-85e1-eabe283b1056, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43386a4-b2c1-4771-a83d-c4ee2c7b0a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:03 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064de837-7ce5-40a8-bd82-6810feb45032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-110d9a90-1318-459b-85e1-eabe283b1056 1073741824" returned: 0 in 0.396s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-110d9a90-1318-459b-85e1-eabe283b1056 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:04 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Volume volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 (f0ca02fb-7cf7-4554-9246-caed3e6addd3): created successfully
Sep 18 01:10:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064de837-7ce5-40a8-bd82-6810feb45032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Flow 'volume_create_manager' (90344dec-121b-4226-895c-acb06c28d9be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:10:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-110d9a90-1318-459b-85e1-eabe283b1056" returned: 0 in 0.367s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] <== create_volume: return (785ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:10:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:04 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3a709832-edcf-4527-af95-182e769d9c2d tempest-VolumesDeleteCascade-7484631 None] Created volume successfully.
Sep 18 01:10:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637582d7-cf41-4326-bf7f-610d08095ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-110d9a90-1318-459b-85e1-eabe283b1056', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d4f80c-5085-4c7b-bee2-793c3cf29e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:04 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Volume volume-110d9a90-1318-459b-85e1-eabe283b1056 (110d9a90-1318-459b-85e1-eabe283b1056): created successfully
Sep 18 01:10:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d4f80c-5085-4c7b-bee2-793c3cf29e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Flow 'volume_create_manager' (eafe531c-9d99-4271-bc66-f6a374e0ca99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:10:04 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-565da3b9-a69f-4ee8-a341-b0893042f245 tempest-VolumesTransfersV355Test-963594546 None] Created volume successfully.
Sep 18 01:10:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Acquiring lock "cinder-110d9a90-1318-459b-85e1-eabe283b1056-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Lock "cinder-110d9a90-1318-459b-85e1-eabe283b1056-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:05 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Acquiring lock "cinder-quobyte-110d9a90-1318-459b-85e1-eabe283b1056" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Lock "cinder-quobyte-110d9a90-1318-459b-85e1-eabe283b1056" acquired by "delete_volume" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:05 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[55011ebc-1f21-48a1-b836-8a5236dae25e]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-110d9a90-1318-459b-85e1-eabe283b1056 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:05 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] Creating offline snapshot 97b72486-2f47-444b-9a1d-64f7786a5495 of volume f0ca02fb-7cf7-4554-9246-caed3e6addd3 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:10:05 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[90053c58-f2db-4965-adac-8de4c794af84]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-110d9a90-1318-459b-85e1-eabe283b1056" returned: 0 in 0.760s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-110d9a90-1318-459b-85e1-eabe283b1056 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-110d9a90-1318-459b-85e1-eabe283b1056" returned: 0 in 0.172s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Lock "cinder-quobyte-110d9a90-1318-459b-85e1-eabe283b1056" released by "delete_volume" :: held 1.134s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3" returned: 0 in 0.797s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:06 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Created reservations ['e5ad03e3-0c18-4f62-989e-1cd3f0af422b', '5991ca27-31b7-41e3-9906-c80013b017d4', '39fdf980-4612-4ccd-b582-f9260fe9a9b5', '77a28ca5-1f98-413b-8ef1-2886189842ac'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:10:06 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=66, name=volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:10:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495 1G" returned: 0 in 0.406s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] CMD "qemu-img rebase -u -b volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495" returned: 0 in 0.636s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:10:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495" returned: 0 in 0.259s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:10:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495" returned: 0 in 0.413s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.041s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:08 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:08 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.info" returned: 0 in 0.440s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:08 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:10:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.info" returned: 0 in 0.179s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.541s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.972s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:09 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:10:09 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Deleted volume successfully.
Sep 18 01:10:09 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-28dbeedf-c2f3-4c4e-8ad1-a92017abc772 tempest-VolumesDeleteCascade-7484631 None] Create snapshot completed successfully
Sep 18 01:10:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-127ecc97-43eb-49fd-8790-d18eaf889894 tempest-VolumesTransfersV355Test-1569805090 None] Lock "cinder-110d9a90-1318-459b-85e1-eabe283b1056-delete_volume" released by "delete_volume" :: held 5.127s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:11 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:11 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Flow 'volume_create_manager' (fef8ee08-f7f0-4980-b781-041a335ba5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160a75ff-eb70-44b0-bfe7-623dae90f4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160a75ff-eb70-44b0-bfe7-623dae90f4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-205340546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a752ff-30bd-4a89-9950-bbf129846716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d8d0f762f14b7abf6239eb6c5f837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=97b72486-2f47-444b-9a1d-64f7786a5495,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:10:12Z,use_quota=True,user_id='aafad12e4a934312ae3032d30198771a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb691f0f-5c0e-423d-bfbb-26187f0b899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb691f0f-5c0e-423d-bfbb-26187f0b899a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e095df4-6fa9-4bdb-a123-ef5dc0d7e4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e095df4-6fa9-4bdb-a123-ef5dc0d7e4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '58a752ff-30bd-4a89-9950-bbf129846716', 'volume_name': 'volume-58a752ff-30bd-4a89-9950-bbf129846716', 'volume_size': 1, 'snapshot_id': '97b72486-2f47-444b-9a1d-64f7786a5495'}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7799d1d-0288-48ab-a765-b5f9ee0db7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7799d1d-0288-48ab-a765-b5f9ee0db7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab0b894-e0c4-40f9-af2b-571e592715f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:12 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Volume 58a752ff-30bd-4a89-9950-bbf129846716: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-58a752ff-30bd-4a89-9950-bbf129846716', 'volume_size': 1, 'snapshot_id': '97b72486-2f47-444b-9a1d-64f7786a5495'}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-quobyte-97b72486-2f47-444b-9a1d-64f7786a5495-58a752ff-30bd-4a89-9950-bbf129846716" by "_create_volume_from_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-97b72486-2f47-444b-9a1d-64f7786a5495-58a752ff-30bd-4a89-9950-bbf129846716" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Creating volume 58a752ff-30bd-4a89-9950-bbf129846716 from snapshot 97b72486-2f47-444b-9a1d-64f7786a5495 {{(pid=84134) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-quobyte-58a752ff-30bd-4a89-9950-bbf129846716" by "_copy_volume_from_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-58a752ff-30bd-4a89-9950-bbf129846716" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] snapshot: 97b72486-2f47-444b-9a1d-64f7786a5495, volume: 58a752ff-30bd-4a89-9950-bbf129846716,  {{(pid=84134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84fd15b-03eb-429a-82af-30183c468d46]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495" returned: 0 in 0.484s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] will copy from snapshot at /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 {{(pid=84134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Creating direct copy from snapshot {{(pid=84134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[375ce6c3-7ff6-4a8f-ae9c-fbb0c3dbddd9]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3" returned: 0 in 0.516s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:13 devstack cinder-volume[84134]: DEBUG cinder.utils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58a752ff-30bd-4a89-9950-bbf129846716 not found in is_blk_device check {{(pid=84134) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 01:10:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58a752ff-30bd-4a89-9950-bbf129846716 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:13 devstack quobyte-client[84147]: System call of process 93778 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:10:13 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=68, name=volume-58a752ff-30bd-4a89-9950-bbf129846716, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:10:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58a752ff-30bd-4a89-9950-bbf129846716" returned: 0 in 5.880s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:19 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c105dafb-6ed6-4690-897b-5ca400feb581]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3" returned: 0 in 0.934s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:20 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Image conversion details: src /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58a752ff-30bd-4a89-9950-bbf129846716 {{(pid=84134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 01:10:20 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Converted 1024.00 MB image at 172.50 MB/s
Sep 18 01:10:20 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58a752ff-30bd-4a89-9950-bbf129846716 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:10:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58a752ff-30bd-4a89-9950-bbf129846716 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58a752ff-30bd-4a89-9950-bbf129846716" returned: 0 in 0.779s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:21 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Flow 'volume_create_manager' (71be4b89-c88a-47d9-8c76-a4f730fe2486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790c0e5c-c294-4eaf-9853-2fe47f273f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-58a752ff-30bd-4a89-9950-bbf129846716" released by "_copy_volume_from_snapshot" :: held 9.626s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790c0e5c-c294-4eaf-9853-2fe47f273f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1749871385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d1dd60-2561-4465-a27a-57ba9bc5e36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd075e1d2f04248a616371c219f9da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:10:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:10:20Z,use_quota=True,user_id='b3cd3550f8ad46b18f0dfe01440ee3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a2230d-fdc8-44b3-8ed2-417346250344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a2230d-fdc8-44b3-8ed2-417346250344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d627488-2b86-41e3-a6b2-d9f3f59675a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d627488-2b86-41e3-a6b2-d9f3f59675a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d1dd60-2561-4465-a27a-57ba9bc5e36b', 'volume_name': 'volume-45d1dd60-2561-4465-a27a-57ba9bc5e36b', 'volume_size': 2}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a18bd6-d8d7-4c39-9dab-ea80177bcfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a18bd6-d8d7-4c39-9dab-ea80177bcfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee15c0e-b10e-447f-a9f5-927c765fefb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:21 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Volume 45d1dd60-2561-4465-a27a-57ba9bc5e36b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d1dd60-2561-4465-a27a-57ba9bc5e36b', 'volume_size': 2}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-97b72486-2f47-444b-9a1d-64f7786a5495-58a752ff-30bd-4a89-9950-bbf129846716" released by "_create_volume_from_snapshot" :: held 9.751s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.793s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1749871385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d1dd60-2561-4465-a27a-57ba9bc5e36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd075e1d2f04248a616371c219f9da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:10:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:10:20Z,use_quota=True,user_id='b3cd3550f8ad46b18f0dfe01440ee3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Creating volume 45d1dd60-2561-4465-a27a-57ba9bc5e36b {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:10:21 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:10:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-45d1dd60-2561-4465-a27a-57ba9bc5e36b 2147483648 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:22 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=69, name=volume-45d1dd60-2561-4465-a27a-57ba9bc5e36b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:10:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab0b894-e0c4-40f9-af2b-571e592715f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a752ff-30bd-4a89-9950-bbf129846716', 'volume_size': 1, 'snapshot_id': '97b72486-2f47-444b-9a1d-64f7786a5495'}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab534ab-e0b8-45e4-81c2-e4d276e02b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:22 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Volume volume-58a752ff-30bd-4a89-9950-bbf129846716 (58a752ff-30bd-4a89-9950-bbf129846716): created successfully
Sep 18 01:10:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab534ab-e0b8-45e4-81c2-e4d276e02b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Flow 'volume_create_manager' (fef8ee08-f7f0-4980-b781-041a335ba5af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:10:23 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5f825c4c-23a9-4e73-add3-4b307b0fbab4 tempest-VolumesDeleteCascade-7484631 None] Created volume successfully.
Sep 18 01:10:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-45d1dd60-2561-4465-a27a-57ba9bc5e36b 2147483648" returned: 0 in 1.191s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-45d1dd60-2561-4465-a27a-57ba9bc5e36b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-45d1dd60-2561-4465-a27a-57ba9bc5e36b" returned: 0 in 0.240s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] <== create_volume: return (1489ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:10:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee15c0e-b10e-447f-a9f5-927c765fefb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d1dd60-2561-4465-a27a-57ba9bc5e36b', 'volume_size': 2}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aeeb1d1-f96d-4a6a-9f42-85aab5b463d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:23 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Volume volume-45d1dd60-2561-4465-a27a-57ba9bc5e36b (45d1dd60-2561-4465-a27a-57ba9bc5e36b): created successfully
Sep 18 01:10:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aeeb1d1-f96d-4a6a-9f42-85aab5b463d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Flow 'volume_create_manager' (71be4b89-c88a-47d9-8c76-a4f730fe2486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:10:24 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-fa7501e6-5646-40ca-bf51-db752534154a tempest-VolumesCloneNegativeTest-2076131559 None] Created volume successfully.
Sep 18 01:10:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-f0ca02fb-7cf7-4554-9246-caed3e6addd3-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-f0ca02fb-7cf7-4554-9246-caed3e6addd3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:24 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Performing cascade delete. {{(pid=84134) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 18 01:10:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-97b72486-2f47-444b-9a1d-64f7786a5495-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-97b72486-2f47-444b-9a1d-64f7786a5495-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:24 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-quobyte-f0ca02fb-7cf7-4554-9246-caed3e6addd3" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-f0ca02fb-7cf7-4554-9246-caed3e6addd3" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-quobyte-97b72486-2f47-444b-9a1d-64f7786a5495" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-97b72486-2f47-444b-9a1d-64f7786a5495" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Deleting offline snapshot 97b72486-2f47-444b-9a1d-64f7786a5495 of volume f0ca02fb-7cf7-4554-9246-caed3e6addd3 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:10:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] snapshot_file for this snap is: volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:10:24 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a05281-7349-4583-8d18-ec186abc7119]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:25 devstack quobyte-client[84147]: System call of process 93874 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:10:25 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Acquiring lock "cinder-45d1dd60-2561-4465-a27a-57ba9bc5e36b-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495" returned: 0 in 0.941s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:10:25 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Lock "cinder-45d1dd60-2561-4465-a27a-57ba9bc5e36b-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:25 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6736e2a-dfd2-4be9-b86c-c13ce6ca0bc7]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:26 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:26 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Acquiring lock "cinder-quobyte-45d1dd60-2561-4465-a27a-57ba9bc5e36b" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:26 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Lock "cinder-quobyte-45d1dd60-2561-4465-a27a-57ba9bc5e36b" acquired by "delete_volume" :: waited 0.059s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:26 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e153c0-f273-4c99-9e35-7ff8f981e44a]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-45d1dd60-2561-4465-a27a-57ba9bc5e36b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3" returned: 0 in 0.827s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495" returned: 0 in 0.280s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3.97b72486-2f47-444b-9a1d-64f7786a5495" returned: 0 in 0.121s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-45d1dd60-2561-4465-a27a-57ba9bc5e36b" returned: 0 in 0.677s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-45d1dd60-2561-4465-a27a-57ba9bc5e36b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:27 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-97b72486-2f47-444b-9a1d-64f7786a5495" released by "_delete_snapshot" :: held 2.812s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-45d1dd60-2561-4465-a27a-57ba9bc5e36b" returned: 0 in 0.244s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:27 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-f0ca02fb-7cf7-4554-9246-caed3e6addd3" released by "delete_snapshot" :: held 2.971s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:27 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Lock "cinder-quobyte-45d1dd60-2561-4465-a27a-57ba9bc5e36b" released by "delete_volume" :: held 1.205s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:27 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Created reservations ['9200a627-3347-4bf8-bda6-f1646e42c776', '7b2acd52-1024-4364-bd3d-c9b90c5147de', '24823968-5ff1-4fb1-8905-a1cdfbcc842a', '3c4bc2f6-801e-4c13-a60d-85a6f6dbedcd'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:10:27 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Created reservations ['3b1e1bd2-b34b-4a8b-a0d1-4dd251975764', 'fe21dc4b-bceb-4f1b-ac02-6d505856ab69', 'fb55e3a2-c0f7-4b3e-818d-ea4a07f34817', 'b4e729b8-169b-4666-ae45-738bcb52657c'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:10:28 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Delete snapshot completed successfully.
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-97b72486-2f47-444b-9a1d-64f7786a5495-delete_snapshot" released by "delete_snapshot" :: held 3.527s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Snapshots deleted, issuing volume delete {{(pid=84134) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-quobyte-f0ca02fb-7cf7-4554-9246-caed3e6addd3" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-f0ca02fb-7cf7-4554-9246-caed3e6addd3" acquired by "delete_volume" :: waited 0.165s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.201s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:10:28 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Deleted volume successfully.
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ed5064-77b4-44e3-9a64-31bfb908fa29]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:28 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f55d5b1-1a48-4bfa-9966-5a88b4a83ee0 tempest-VolumesCloneNegativeTest-2076131559 None] Lock "cinder-45d1dd60-2561-4465-a27a-57ba9bc5e36b-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:29 devstack quobyte-client[84147]: System call of process 93897 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:10:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3" returned: 0 in 0.681s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f0ca02fb-7cf7-4554-9246-caed3e6addd3" returned: 0 in 0.114s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:29 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-f0ca02fb-7cf7-4554-9246-caed3e6addd3" released by "delete_volume" :: held 1.171s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:29 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Created reservations ['3c4a2f02-9140-4632-bb64-13a7bb1400f9', '3460fd25-7482-45fa-87c1-4f4319544823', 'de1c2f45-cf7b-49b9-96c3-e1da1deaa348', '3c72fd8c-1e44-4590-93fd-9353a3ff608b'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:10:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.272s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:30 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:10:30 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Deleted volume successfully.
Sep 18 01:10:30 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-60662597-bbf5-4ba6-91d5-e5f4adedd413 tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-f0ca02fb-7cf7-4554-9246-caed3e6addd3-delete_volume" released by "delete_volume" :: held 6.642s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-58a752ff-30bd-4a89-9950-bbf129846716-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-58a752ff-30bd-4a89-9950-bbf129846716-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:31 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "cinder-quobyte-58a752ff-30bd-4a89-9950-bbf129846716" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-58a752ff-30bd-4a89-9950-bbf129846716" acquired by "delete_volume" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:31 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1f9870-6903-4f05-a17e-65c4d2e82d58]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58a752ff-30bd-4a89-9950-bbf129846716 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:32 devstack quobyte-client[84147]: System call of process 93904 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:10:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58a752ff-30bd-4a89-9950-bbf129846716" returned: 0 in 0.703s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58a752ff-30bd-4a89-9950-bbf129846716 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58a752ff-30bd-4a89-9950-bbf129846716" returned: 0 in 0.199s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:33 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-quobyte-58a752ff-30bd-4a89-9950-bbf129846716" released by "delete_volume" :: held 1.352s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:33 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=63,cinder:INSERT=11,cinder:UPDATE=72,cinder:DELETE=9 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:10:33 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=89,cinder:DELETE=7,cinder:SELECT=60,cinder:INSERT=25 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:10:33 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Created reservations ['e1107809-5d4f-4ffd-bc53-365ba48ea320', 'a0a2659f-3033-4983-a907-6a99852eb607', 'cfa69063-98b4-468e-b35c-25557b9b0a56', '380e3274-0b04-44d1-9c39-aa65ab4e5ea0'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.512s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:10:34 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Deleted volume successfully.
Sep 18 01:10:34 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Flow 'volume_create_manager' (e51e76df-2ca7-43a2-b142-261aeee4dbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfb7f6d-ac37-4ddd-be24-829969ebef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c91457cd-d287-4a6c-8c4d-917b73d55bae tempest-VolumesDeleteCascade-7484631 None] Lock "cinder-58a752ff-30bd-4a89-9950-bbf129846716-delete_volume" released by "delete_volume" :: held 3.392s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfb7f6d-ac37-4ddd-be24-829969ebef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1135544687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4ddb49-a78f-4309-8a73-ea096547debc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='989260107ff34a06bd1861658f5a3652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:10:34Z,use_quota=True,user_id='e4afd808b89b4fdf97be19b1d6a1b05e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c351daf2-1506-46de-8a71-28a4634412ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c351daf2-1506-46de-8a71-28a4634412ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83949b2f-cd70-4401-942a-42690f62389d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83949b2f-cd70-4401-942a-42690f62389d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4ddb49-a78f-4309-8a73-ea096547debc', 'volume_name': 'volume-1f4ddb49-a78f-4309-8a73-ea096547debc', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35df450a-6f93-42f8-a712-d5181595f849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35df450a-6f93-42f8-a712-d5181595f849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe70879-a79c-488e-8b0e-c066ec62863c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:34 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Volume 1f4ddb49-a78f-4309-8a73-ea096547debc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4ddb49-a78f-4309-8a73-ea096547debc', 'volume_size': 1}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1135544687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4ddb49-a78f-4309-8a73-ea096547debc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='989260107ff34a06bd1861658f5a3652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:10:34Z,use_quota=True,user_id='e4afd808b89b4fdf97be19b1d6a1b05e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Creating volume 1f4ddb49-a78f-4309-8a73-ea096547debc {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:10:34 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:10:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:35 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=70, name=volume-1f4ddb49-a78f-4309-8a73-ea096547debc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:10:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc 1073741824" returned: 0 in 0.608s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc" returned: 0 in 0.136s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] <== create_volume: return (837ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:10:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe70879-a79c-488e-8b0e-c066ec62863c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4ddb49-a78f-4309-8a73-ea096547debc', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d486e1fb-e378-4c63-9f58-91518a9f11b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:36 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Volume volume-1f4ddb49-a78f-4309-8a73-ea096547debc (1f4ddb49-a78f-4309-8a73-ea096547debc): created successfully
Sep 18 01:10:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d486e1fb-e378-4c63-9f58-91518a9f11b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Flow 'volume_create_manager' (e51e76df-2ca7-43a2-b142-261aeee4dbfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:10:36 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-51746355-0540-4596-b036-234f1554a101 tempest-VolumesSnapshotListTestJSON-1467853135 None] Created volume successfully.
Sep 18 01:10:37 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] Creating offline snapshot c142e7cd-63b3-4bc9-b2b7-3572fe272268 of volume 1f4ddb49-a78f-4309-8a73-ea096547debc {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:10:38 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3f2cb2-3fe2-4df3-bc7e-52c91ef559b1]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc" returned: 0 in 0.550s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:38 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=71, name=volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:10:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 1G" returned: 0 in 0.263s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1f4ddb49-a78f-4309-8a73-ea096547debc -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "qemu-img rebase -u -b volume-1f4ddb49-a78f-4309-8a73-ea096547debc -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268" returned: 0 in 0.194s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:10:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268" returned: 0 in 0.101s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:10:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268" returned: 0 in 0.105s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.info" returned: 0 in 0.171s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:10:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.info" returned: 0 in 0.348s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.116s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:40 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Flow 'volume_create_manager' (4f8938a4-35e4-48f5-9106-bdd14bcd6ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5ff857-1e62-472a-a1d3-d5d8f9c0a753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5ff857-1e62-472a-a1d3-d5d8f9c0a753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-469438212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662ee865-e95f-463c-8990-27dde0dfe352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='739e596ef5ac458e8bef437c32778f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:10:40Z,use_quota=True,user_id='1c2b3b13aaba4aaf866cee8537d1ff72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434395d2-da03-4701-bce6-848dc66e9ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434395d2-da03-4701-bce6-848dc66e9ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4539bbfd-5b72-46ca-aea0-37abb71d628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4539bbfd-5b72-46ca-aea0-37abb71d628a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662ee865-e95f-463c-8990-27dde0dfe352', 'volume_name': 'volume-662ee865-e95f-463c-8990-27dde0dfe352', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48befa0-d313-4b3e-98f5-57cdd205308b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48befa0-d313-4b3e-98f5-57cdd205308b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263b9b11-8590-42de-9739-a8a8b40a9bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:40 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Volume 662ee865-e95f-463c-8990-27dde0dfe352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662ee865-e95f-463c-8990-27dde0dfe352', 'volume_size': 1}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-469438212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662ee865-e95f-463c-8990-27dde0dfe352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='739e596ef5ac458e8bef437c32778f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:10:40Z,use_quota=True,user_id='1c2b3b13aaba4aaf866cee8537d1ff72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Creating volume 662ee865-e95f-463c-8990-27dde0dfe352 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:10:40 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-662ee865-e95f-463c-8990-27dde0dfe352 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:40 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-40f55459-c5ad-499a-952d-798333b93338 tempest-VolumesSnapshotListTestJSON-1467853135 None] Create snapshot completed successfully
Sep 18 01:10:40 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=73, name=volume-662ee865-e95f-463c-8990-27dde0dfe352, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-662ee865-e95f-463c-8990-27dde0dfe352 1073741824" returned: 0 in 0.558s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-662ee865-e95f-463c-8990-27dde0dfe352 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-662ee865-e95f-463c-8990-27dde0dfe352" returned: 0 in 0.206s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] <== create_volume: return (814ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:10:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263b9b11-8590-42de-9739-a8a8b40a9bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662ee865-e95f-463c-8990-27dde0dfe352', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea23e5ab-f168-41e4-bedd-6f8f2ce698ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:41 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Volume volume-662ee865-e95f-463c-8990-27dde0dfe352 (662ee865-e95f-463c-8990-27dde0dfe352): created successfully
Sep 18 01:10:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea23e5ab-f168-41e4-bedd-6f8f2ce698ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Flow 'volume_create_manager' (4f8938a4-35e4-48f5-9106-bdd14bcd6ce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:10:41 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-1517f0f4-4c3f-4ed5-b56f-2c0de5fd8e8a tempest-VolumesMetadataTest-1876010981 None] Created volume successfully.
Sep 18 01:10:41 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] Creating offline snapshot 34cfae86-7033-4669-a32e-250f039d29e5 of volume 1f4ddb49-a78f-4309-8a73-ea096547debc {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:10:41 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1915d2c0-25d9-4ed0-a12d-cd7bd7636755]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:42 devstack quobyte-client[84147]: System call of process 93933 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:10:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268" returned: 0 in 0.638s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4ddb49-a78f-4309-8a73-ea096547debc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:10:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:42 devstack quobyte-client[84147]: System call of process 93936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:10:42 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=74, name=volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:10:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 1G" returned: 0 in 0.436s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:43 devstack quobyte-client[84147]: System call of process 93939 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:10:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "qemu-img rebase -u -b volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5" returned: 0 in 0.164s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:43 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:10:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Acquiring lock "cinder-662ee865-e95f-463c-8990-27dde0dfe352-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5" returned: 0 in 0.323s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:43 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:10:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5" returned: 0 in 0.210s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Lock "cinder-662ee865-e95f-463c-8990-27dde0dfe352-delete_volume" acquired by "delete_volume" :: waited 0.543s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:44 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-2bc275e9-87f1-409e-a0ee-e2e61b834ad8 tempest-VolumesSnapshotListTestJSON-1467853135 None] Create snapshot completed successfully
Sep 18 01:10:44 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Acquiring lock "cinder-quobyte-662ee865-e95f-463c-8990-27dde0dfe352" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Lock "cinder-quobyte-662ee865-e95f-463c-8990-27dde0dfe352" acquired by "delete_volume" :: waited 0.025s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:44 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e9825f-ed9b-434e-8813-b9842eefdf29]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-662ee865-e95f-463c-8990-27dde0dfe352 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-662ee865-e95f-463c-8990-27dde0dfe352" returned: 0 in 0.443s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-662ee865-e95f-463c-8990-27dde0dfe352 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-662ee865-e95f-463c-8990-27dde0dfe352" returned: 0 in 0.140s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Lock "cinder-quobyte-662ee865-e95f-463c-8990-27dde0dfe352" released by "delete_volume" :: held 0.742s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:45 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Created reservations ['f2c40827-7e2a-49de-8a2e-eb875dbc9da4', '1e1ff8f6-e001-4c66-9cad-0c17a6544889', '0ab9b43e-b91f-4993-afce-053140409321', 'f2529e1a-d74a-40f3-a714-fdbb244048db'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:10:45 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] Creating offline snapshot 2ddb0388-7961-4611-a8e5-2c89bf167a85 of volume 1f4ddb49-a78f-4309-8a73-ea096547debc {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:10:45 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebc09c0-a804-472e-9375-653252c9a222]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.605s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:46 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:10:46 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Deleted volume successfully.
Sep 18 01:10:46 devstack quobyte-client[84147]: System call of process 93950 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:10:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6765c5c9-c728-49bd-95d8-ca1f158b1e1b tempest-VolumesMetadataTest-1876010981 None] Lock "cinder-662ee865-e95f-463c-8990-27dde0dfe352-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5" returned: 0 in 1.060s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4ddb49-a78f-4309-8a73-ea096547debc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:10:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:47 devstack quobyte-client[84147]: System call of process 93954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:10:47 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=75, name=volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:10:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85 1G" returned: 0 in 0.655s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "qemu-img rebase -u -b volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85" returned: 0 in 0.271s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:10:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85" returned: 0 in 0.196s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:10:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85" returned: 0 in 0.328s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.308s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:49 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-020fcf77-cdad-4749-8eda-a88877b91c89 tempest-VolumesSnapshotListTestJSON-1467853135 None] Create snapshot completed successfully
Sep 18 01:10:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "cinder-2ddb0388-7961-4611-a8e5-2c89bf167a85-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-2ddb0388-7961-4611-a8e5-2c89bf167a85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:52 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "cinder-quobyte-1f4ddb49-a78f-4309-8a73-ea096547debc" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-quobyte-1f4ddb49-a78f-4309-8a73-ea096547debc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "cinder-quobyte-2ddb0388-7961-4611-a8e5-2c89bf167a85" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-quobyte-2ddb0388-7961-4611-a8e5-2c89bf167a85" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Deleting offline snapshot 2ddb0388-7961-4611-a8e5-2c89bf167a85 of volume 1f4ddb49-a78f-4309-8a73-ea096547debc {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:10:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] snapshot_file for this snap is: volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:10:52 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71c70ca-2ceb-40d5-b510-7d374c6e06c5]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85" returned: 0 in 0.748s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4ddb49-a78f-4309-8a73-ea096547debc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:10:53 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3550ef86-a613-4706-8c58-b204278e55fb]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5" returned: 0 in 0.698s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4ddb49-a78f-4309-8a73-ea096547debc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:10:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:54 devstack quobyte-client[84147]: System call of process 93976 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:10:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85" returned: 0 in 0.387s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.2ddb0388-7961-4611-a8e5-2c89bf167a85" returned: 0 in 0.137s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-quobyte-2ddb0388-7961-4611-a8e5-2c89bf167a85" released by "_delete_snapshot" :: held 2.380s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-quobyte-1f4ddb49-a78f-4309-8a73-ea096547debc" released by "delete_snapshot" :: held 2.424s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:55 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Flow 'volume_create_manager' (4e62a9a0-5b0b-42df-b2a6-c52c57309bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ec322a-5820-47c9-8a60-e13cd5352914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Created reservations ['c4ebb9ad-be7b-4350-9bdf-a7fff01868ba', '3abce0f6-f5b9-460e-bb94-b3d02651d985', '0ee9d9b9-077f-49d1-ab29-1cc300e9d61c', '9ee4de13-cda3-4315-b447-ad686ebe45d4'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ec322a-5820-47c9-8a60-e13cd5352914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-678330949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df06648-1a58-4f97-9313-de62d1c82df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb852359e0640f4a97c47c9bdb3d29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:10:55Z,use_quota=True,user_id='447769483d8642269c96e6eb4e7d5bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e39d92-25ed-40f0-83fd-169db3b5de1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e39d92-25ed-40f0-83fd-169db3b5de1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c413eb4e-7e16-4757-849f-1294ce71346a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c413eb4e-7e16-4757-849f-1294ce71346a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1df06648-1a58-4f97-9313-de62d1c82df8', 'volume_name': 'volume-1df06648-1a58-4f97-9313-de62d1c82df8', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497826fa-6e28-4fff-9ad0-91a210249981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497826fa-6e28-4fff-9ad0-91a210249981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c522e2e-26e5-430b-a517-e34fd6b1652a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:55 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Volume 1df06648-1a58-4f97-9313-de62d1c82df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1df06648-1a58-4f97-9313-de62d1c82df8', 'volume_size': 1}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-678330949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df06648-1a58-4f97-9313-de62d1c82df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb852359e0640f4a97c47c9bdb3d29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:10:55Z,use_quota=True,user_id='447769483d8642269c96e6eb4e7d5bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Creating volume 1df06648-1a58-4f97-9313-de62d1c82df8 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:10:55 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:10:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1df06648-1a58-4f97-9313-de62d1c82df8 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:56 devstack quobyte-client[84147]: System call of process 93980 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:10:56 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=76, name=volume-1df06648-1a58-4f97-9313-de62d1c82df8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:10:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1df06648-1a58-4f97-9313-de62d1c82df8 1073741824" returned: 0 in 0.496s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1df06648-1a58-4f97-9313-de62d1c82df8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1df06648-1a58-4f97-9313-de62d1c82df8" returned: 0 in 0.280s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] <== create_volume: return (836ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:10:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:56 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Delete snapshot completed successfully.
Sep 18 01:10:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:10:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:10:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:10:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:10:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:10:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:10:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c522e2e-26e5-430b-a517-e34fd6b1652a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df06648-1a58-4f97-9313-de62d1c82df8', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92673045-9be2-4f42-96bc-942b725d9e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ded49cef-5f7f-4030-b7ea-6a4434e028c4 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-2ddb0388-7961-4611-a8e5-2c89bf167a85-delete_snapshot" released by "delete_snapshot" :: held 4.706s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "cinder-34cfae86-7033-4669-a32e-250f039d29e5-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:57 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Volume volume-1df06648-1a58-4f97-9313-de62d1c82df8 (1df06648-1a58-4f97-9313-de62d1c82df8): created successfully
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92673045-9be2-4f42-96bc-942b725d9e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Flow 'volume_create_manager' (4e62a9a0-5b0b-42df-b2a6-c52c57309bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.562s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-34cfae86-7033-4669-a32e-250f039d29e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.121s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:57 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "cinder-quobyte-1f4ddb49-a78f-4309-8a73-ea096547debc" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:57 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-0bcddf5c-1080-4da0-a598-d07857708924 tempest-VolumesTransfersTest-1624971092 None] Created volume successfully.
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-quobyte-1f4ddb49-a78f-4309-8a73-ea096547debc" acquired by "delete_snapshot" :: waited 0.040s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "cinder-quobyte-34cfae86-7033-4669-a32e-250f039d29e5" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-quobyte-34cfae86-7033-4669-a32e-250f039d29e5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Deleting offline snapshot 34cfae86-7033-4669-a32e-250f039d29e5 of volume 1f4ddb49-a78f-4309-8a73-ea096547debc {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] snapshot_file for this snap is: volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd77402-87ab-41a4-9472-49bdbfea616b]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:58 devstack quobyte-client[84147]: System call of process 93986 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:10:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5" returned: 0 in 0.564s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4ddb49-a78f-4309-8a73-ea096547debc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:10:58 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eae42c-1a5b-4a01-97a7-fc94f997df87]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:10:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:58 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5c38091b-3f8d-4dcb-9bad-74c771a44046 tempest-VolumesTransfersTest-51126284 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:10:58 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5c38091b-3f8d-4dcb-9bad-74c771a44046 tempest-VolumesTransfersTest-51126284 None] Transfer volume completed successfully.
Sep 18 01:10:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268" returned: 0 in 0.733s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4ddb49-a78f-4309-8a73-ea096547debc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:10:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:59 devstack quobyte-client[84147]: System call of process 93992 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:10:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5" returned: 0 in 0.346s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:10:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.34cfae86-7033-4669-a32e-250f039d29e5" returned: 0 in 0.180s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:10:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-quobyte-34cfae86-7033-4669-a32e-250f039d29e5" released by "_delete_snapshot" :: held 2.143s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:10:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-quobyte-1f4ddb49-a78f-4309-8a73-ea096547debc" released by "delete_snapshot" :: held 2.180s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:11:00 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Acquiring lock "cinder-1df06648-1a58-4f97-9313-de62d1c82df8-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:11:00 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Lock "cinder-1df06648-1a58-4f97-9313-de62d1c82df8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:11:00 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:11:00 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Acquiring lock "cinder-quobyte-1df06648-1a58-4f97-9313-de62d1c82df8" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:11:00 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Created reservations ['0afcd5e8-6d29-48ae-895a-e83522802519', '5ecb6bed-cff6-4051-ba83-5005c6a1bd8b', '116371f1-8f55-4e79-9fa0-ee1c4621f029', '991ea326-b856-4704-9762-33a037d07344'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:11:00 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Lock "cinder-quobyte-1df06648-1a58-4f97-9313-de62d1c82df8" acquired by "delete_volume" :: waited 0.018s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:11:00 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8f4c6b-f2ba-4036-ba7f-c6eb393e4947]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:11:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1df06648-1a58-4f97-9313-de62d1c82df8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:00 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Delete snapshot completed successfully.
Sep 18 01:11:00 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6733c1d9-8934-48ef-aac8-7aa03f02b851 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-34cfae86-7033-4669-a32e-250f039d29e5-delete_snapshot" released by "delete_snapshot" :: held 3.198s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:11:00 devstack quobyte-client[84147]: System call of process 93996 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:11:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1df06648-1a58-4f97-9313-de62d1c82df8" returned: 0 in 0.701s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1df06648-1a58-4f97-9313-de62d1c82df8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1df06648-1a58-4f97-9313-de62d1c82df8" returned: 0 in 0.162s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Lock "cinder-quobyte-1df06648-1a58-4f97-9313-de62d1c82df8" released by "delete_volume" :: held 1.083s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:11:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "cinder-c142e7cd-63b3-4bc9-b2b7-3572fe272268-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:11:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-c142e7cd-63b3-4bc9-b2b7-3572fe272268-delete_snapshot" acquired by "delete_snapshot" :: waited 0.113s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:11:01 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:11:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "cinder-quobyte-1f4ddb49-a78f-4309-8a73-ea096547debc" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:11:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-quobyte-1f4ddb49-a78f-4309-8a73-ea096547debc" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:11:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "cinder-quobyte-c142e7cd-63b3-4bc9-b2b7-3572fe272268" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:11:01 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Created reservations ['e21343f3-1a39-4b2e-afce-c51afe869403', '860cd849-09f8-4058-b0fc-17f0ddb6081b', 'a4e06c27-8fa8-4fd8-a95f-1cd4a7ac2cf0', 'd3d04a7a-3464-4d77-9e05-8a946b20a828'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:11:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-quobyte-c142e7cd-63b3-4bc9-b2b7-3572fe272268" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:11:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Deleting offline snapshot c142e7cd-63b3-4bc9-b2b7-3572fe272268 of volume 1f4ddb49-a78f-4309-8a73-ea096547debc {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:11:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] snapshot_file for this snap is: volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:11:01 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ddc037-0d57-4a7d-951b-5627f188ebdc]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:11:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268" returned: 0 in 0.707s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4ddb49-a78f-4309-8a73-ea096547debc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:11:02 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dabb9d6-64f6-4691-83ab-dcaf62574a00]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:11:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:11:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.047s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:11:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:11:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:11:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:11:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc" returned: 0 in 0.678s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:03 devstack quobyte-client[84147]: System call of process 94052 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:11:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268" returned: 0 in 0.412s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.631s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:11:04 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Deleted volume successfully.
Sep 18 01:11:04 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Flow 'volume_create_manager' (eb524b1b-1926-4e16-9fea-eed15199b61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be0ad4f-5c15-4f28-a8fb-a9d602e014b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be0ad4f-5c15-4f28-a8fb-a9d602e014b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-730955735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a030b6-0339-4a28-a951-a2764054a834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb852359e0640f4a97c47c9bdb3d29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:11:03Z,use_quota=True,user_id='447769483d8642269c96e6eb4e7d5bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4af38e5-947c-4736-bbe5-409f4f7f71e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4af38e5-947c-4736-bbe5-409f4f7f71e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8f73eb-9425-49d4-a5c6-4f2b5eb4d0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8f73eb-9425-49d4-a5c6-4f2b5eb4d0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a030b6-0339-4a28-a951-a2764054a834', 'volume_name': 'volume-69a030b6-0339-4a28-a951-a2764054a834', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091b25cb-569e-4dfb-bcfa-02a8e0417502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091b25cb-569e-4dfb-bcfa-02a8e0417502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56df50d5-f603-4296-8874-873c3fa88bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:04 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Volume 69a030b6-0339-4a28-a951-a2764054a834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a030b6-0339-4a28-a951-a2764054a834', 'volume_size': 1}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-730955735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a030b6-0339-4a28-a951-a2764054a834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb852359e0640f4a97c47c9bdb3d29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:11:03Z,use_quota=True,user_id='447769483d8642269c96e6eb4e7d5bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Creating volume 69a030b6-0339-4a28-a951-a2764054a834 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:11:04 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69a030b6-0339-4a28-a951-a2764054a834 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:04 devstack quobyte-client[84147]: System call of process 94056 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:11:04 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=77, name=volume-69a030b6-0339-4a28-a951-a2764054a834, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc.c142e7cd-63b3-4bc9-b2b7-3572fe272268" returned: 0 in 0.841s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-92b11340-0df6-4082-9271-10a2882617aa tempest-VolumesTransfersTest-668097426 None] Lock "cinder-1df06648-1a58-4f97-9313-de62d1c82df8-delete_volume" released by "delete_volume" :: held 4.780s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-quobyte-c142e7cd-63b3-4bc9-b2b7-3572fe272268" released by "_delete_snapshot" :: held 3.018s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69a030b6-0339-4a28-a951-a2764054a834 1073741824" returned: 0 in 0.412s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69a030b6-0339-4a28-a951-a2764054a834 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-quobyte-1f4ddb49-a78f-4309-8a73-ea096547debc" released by "delete_snapshot" :: held 3.187s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:11:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69a030b6-0339-4a28-a951-a2764054a834" returned: 0 in 0.386s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] <== create_volume: return (823ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:11:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:11:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56df50d5-f603-4296-8874-873c3fa88bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a030b6-0339-4a28-a951-a2764054a834', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7a6f70-112f-41b4-9e32-7c925e1f3fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:05 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Volume volume-69a030b6-0339-4a28-a951-a2764054a834 (69a030b6-0339-4a28-a951-a2764054a834): created successfully
Sep 18 01:11:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7a6f70-112f-41b4-9e32-7c925e1f3fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Flow 'volume_create_manager' (eb524b1b-1926-4e16-9fea-eed15199b61b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:11:05 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-25ae818b-91f4-4a98-acaa-af429b0d528c tempest-VolumesTransfersTest-1624971092 None] Created volume successfully.
Sep 18 01:11:05 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Created reservations ['b16770ee-abad-4a61-8d94-250a02b408e0', '18b7f56b-5a5e-4baa-a9f7-8d2d84262700', '3538c5a5-c74b-499f-9998-0dc692eeff4d', 'c59f355d-d7a3-445e-8ea9-223490722606'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:11:05 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Delete snapshot completed successfully.
Sep 18 01:11:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b14da771-cd1a-4293-810d-b7ab99d07d67 tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-c142e7cd-63b3-4bc9-b2b7-3572fe272268-delete_snapshot" released by "delete_snapshot" :: held 3.823s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:11:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "cinder-1f4ddb49-a78f-4309-8a73-ea096547debc-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:11:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-1f4ddb49-a78f-4309-8a73-ea096547debc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:11:06 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:11:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "cinder-quobyte-1f4ddb49-a78f-4309-8a73-ea096547debc" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:11:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-quobyte-1f4ddb49-a78f-4309-8a73-ea096547debc" acquired by "delete_volume" :: waited 0.015s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:11:06 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[820af8ea-56d8-4fbb-af2c-4777548c6d5b]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:11:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc" returned: 0 in 0.484s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-1f4ddb49-a78f-4309-8a73-ea096547debc" returned: 0 in 0.102s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-quobyte-1f4ddb49-a78f-4309-8a73-ea096547debc" released by "delete_volume" :: held 0.811s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Acquiring lock "cinder-69a030b6-0339-4a28-a951-a2764054a834-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Created reservations ['551dccf8-47be-40c2-85da-10874bd7a938', '82234441-063d-4095-ad43-66329701269d', 'cf2cec67-c442-44c8-bcdc-a2ba8ca403b3', '4112da33-5856-4991-99e9-ee8a93f0fd86'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Lock "cinder-69a030b6-0339-4a28-a951-a2764054a834-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:11:07 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Acquiring lock "cinder-quobyte-69a030b6-0339-4a28-a951-a2764054a834" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.169s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:11:07 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Deleted volume successfully.
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Lock "cinder-quobyte-69a030b6-0339-4a28-a951-a2764054a834" acquired by "delete_volume" :: waited 0.380s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d91cf6-dd6c-488b-8866-702da6823ddb]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:11:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69a030b6-0339-4a28-a951-a2764054a834 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-24df95e7-cc36-4566-8916-1ea663cb25ea tempest-VolumesSnapshotListTestJSON-1467853135 None] Lock "cinder-1f4ddb49-a78f-4309-8a73-ea096547debc-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:11:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69a030b6-0339-4a28-a951-a2764054a834" returned: 0 in 0.589s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69a030b6-0339-4a28-a951-a2764054a834 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-69a030b6-0339-4a28-a951-a2764054a834" returned: 0 in 0.131s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Lock "cinder-quobyte-69a030b6-0339-4a28-a951-a2764054a834" released by "delete_volume" :: held 0.968s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:11:09 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Created reservations ['84da86b8-0a17-41f4-b099-bd8d5702c148', 'd8c64214-c3d7-4585-96e1-ead2404690f0', 'b78354e0-060d-428b-9d5e-c95f31475053', 'bdea0084-a5b1-4e89-8446-312e96f0fe81'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:11:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:11:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:11:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:11:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:11:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:11:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.195s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:09 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:11:09 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Deleted volume successfully.
Sep 18 01:11:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-20cdafd4-7d5e-40c7-8be3-57a10a783c05 tempest-VolumesTransfersTest-668097426 None] Lock "cinder-69a030b6-0339-4a28-a951-a2764054a834-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:11:26 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=47,cinder:SELECT=40,cinder:DELETE=7,cinder:INSERT=15 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:11:26 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=52,cinder:INSERT=17,cinder:UPDATE=88,cinder:DELETE=5 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:11:30 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Flow 'volume_create_manager' (5aef67a5-e5bb-42c9-86bb-c57fb69f6bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01e70a2-b5b4-40a7-8da0-45415c194af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01e70a2-b5b4-40a7-8da0-45415c194af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1988116971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf388b9-262e-495d-827e-cc5691552318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c1403ee4d949a696fb86cf9748ceaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:11:30Z,use_quota=True,user_id='b2564e0ca1ef4f31b6dae1e708c3c2ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f58f20-36a9-4691-a0af-4bcc488e3c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f58f20-36a9-4691-a0af-4bcc488e3c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4179d8-a232-466d-9914-8bad84209723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4179d8-a232-466d-9914-8bad84209723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bf388b9-262e-495d-827e-cc5691552318', 'volume_name': 'volume-7bf388b9-262e-495d-827e-cc5691552318', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24fc1408-e2e0-4957-9e61-c69a2617da38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24fc1408-e2e0-4957-9e61-c69a2617da38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114d10a5-e6e4-4fda-b18f-7855484245c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:30 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Volume 7bf388b9-262e-495d-827e-cc5691552318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bf388b9-262e-495d-827e-cc5691552318', 'volume_size': 1}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1988116971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf388b9-262e-495d-827e-cc5691552318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c1403ee4d949a696fb86cf9748ceaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:11:30Z,use_quota=True,user_id='b2564e0ca1ef4f31b6dae1e708c3c2ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Creating volume 7bf388b9-262e-495d-827e-cc5691552318 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:11:30 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:11:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:31 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=78, name=volume-7bf388b9-262e-495d-827e-cc5691552318, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:11:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 1073741824" returned: 0 in 0.719s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318" returned: 0 in 0.185s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] <== create_volume: return (1083ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:11:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:11:32 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114d10a5-e6e4-4fda-b18f-7855484245c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bf388b9-262e-495d-827e-cc5691552318', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:32 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5449a3f4-00de-47b4-98df-cd7525b25717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:32 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Volume volume-7bf388b9-262e-495d-827e-cc5691552318 (7bf388b9-262e-495d-827e-cc5691552318): created successfully
Sep 18 01:11:32 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5449a3f4-00de-47b4-98df-cd7525b25717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:32 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Flow 'volume_create_manager' (5aef67a5-e5bb-42c9-86bb-c57fb69f6bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:11:32 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-96c0092a-9798-44d5-ba31-51f6f61c1d97 tempest-VolumesActionsTest-1804509687 None] Created volume successfully.
Sep 18 01:11:39 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Flow 'volume_create_manager' (fb23d717-7f8d-40d0-80d7-0bb4f151d78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14dce72d-7817-49c3-804b-03e7f8c3ec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14dce72d-7817-49c3-804b-03e7f8c3ec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2108198266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9497e20f-a203-48a6-802d-2a3bd8a5eee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6920fc1d0554b32beb791855050a1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:11:39Z,use_quota=True,user_id='432d409366d04016a55c80563699e1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e3fdd4-5392-4d2c-9d12-03a738a55a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e3fdd4-5392-4d2c-9d12-03a738a55a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8b5b70-739f-4673-a7ea-6dc89d324039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8b5b70-739f-4673-a7ea-6dc89d324039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9497e20f-a203-48a6-802d-2a3bd8a5eee8', 'volume_name': 'volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f1049d-cbb5-4ac0-8eb0-5e107ba3daec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f1049d-cbb5-4ac0-8eb0-5e107ba3daec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3dde22-3f8a-40e5-9b93-91950fad238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:39 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Volume 9497e20f-a203-48a6-802d-2a3bd8a5eee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8', 'volume_size': 1}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2108198266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9497e20f-a203-48a6-802d-2a3bd8a5eee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6920fc1d0554b32beb791855050a1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:11:39Z,use_quota=True,user_id='432d409366d04016a55c80563699e1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Creating volume 9497e20f-a203-48a6-802d-2a3bd8a5eee8 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:11:39 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:11:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:40 devstack quobyte-client[84147]: System call of process 94104 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:11:40 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=79, name=volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:11:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8 1073741824" returned: 0 in 0.932s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8" returned: 0 in 0.209s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] <== create_volume: return (1369ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:11:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:11:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3dde22-3f8a-40e5-9b93-91950fad238d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59acab2-83ae-41e2-af9c-c13bb31b23be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:11:41 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Volume volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8 (9497e20f-a203-48a6-802d-2a3bd8a5eee8): created successfully
Sep 18 01:11:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59acab2-83ae-41e2-af9c-c13bb31b23be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:11:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Flow 'volume_create_manager' (fb23d717-7f8d-40d0-80d7-0bb4f151d78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:11:41 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-a158af9b-4ecf-4651-95eb-76d0f1eb8fe5 tempest-AttachVolumeNegativeTest-1787668276 None] Created volume successfully.
Sep 18 01:11:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-a32be28d-60be-442e-b77e-e839408b0124 req-f7469abe-117a-4cab-ae6e-221e3b096feb tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:11:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-a32be28d-60be-442e-b77e-e839408b0124 req-f7469abe-117a-4cab-ae6e-221e3b096feb tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:11:48 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a822b1-b39a-43b5-91b3-2e621b65b3f3]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:11:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-a32be28d-60be-442e-b77e-e839408b0124 req-f7469abe-117a-4cab-ae6e-221e3b096feb tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-a32be28d-60be-442e-b77e-e839408b0124 req-f7469abe-117a-4cab-ae6e-221e3b096feb tempest-AttachVolumeNegativeTest-1787668276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8" returned: 0 in 0.742s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-a32be28d-60be-442e-b77e-e839408b0124 req-f7469abe-117a-4cab-ae6e-221e3b096feb tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.829s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:11:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-a32be28d-60be-442e-b77e-e839408b0124 req-f7469abe-117a-4cab-ae6e-221e3b096feb tempest-AttachVolumeNegativeTest-1787668276 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba8f0983-fc01-4dd5-8c89-ac70f5b03db4', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:11:49 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-a32be28d-60be-442e-b77e-e839408b0124 req-f7469abe-117a-4cab-ae6e-221e3b096feb tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:11:49 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-a32be28d-60be-442e-b77e-e839408b0124 req-f7469abe-117a-4cab-ae6e-221e3b096feb tempest-AttachVolumeNegativeTest-1787668276 None] attachment_update completed successfully.
Sep 18 01:11:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:11:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:11:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:11:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:11:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:11:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:11:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:11:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.441s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:11:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:11:59 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=6,cinder:SELECT=8,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:11:59 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:12:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-980925f8-faad-43e2-b07e-c1863e733fd5 tempest-VolumesActionsTest-1804509687 None] Acquiring lock "cinder-7bf388b9-262e-495d-827e-cc5691552318" by "attach_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:12:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-980925f8-faad-43e2-b07e-c1863e733fd5 tempest-VolumesActionsTest-1804509687 None] Lock "cinder-7bf388b9-262e-495d-827e-cc5691552318" acquired by "attach_volume" :: waited 0.049s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:12:07 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-980925f8-faad-43e2-b07e-c1863e733fd5 tempest-VolumesActionsTest-1804509687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:12:07 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-980925f8-faad-43e2-b07e-c1863e733fd5 tempest-VolumesActionsTest-1804509687 None] Attaching volume 7bf388b9-262e-495d-827e-cc5691552318 to instance 4e418183-5389-4377-b229-41c8e1a6b441 at mountpoint /dev/vdb on host None.
Sep 18 01:12:07 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-980925f8-faad-43e2-b07e-c1863e733fd5 tempest-VolumesActionsTest-1804509687 None] Attach volume completed successfully.
Sep 18 01:12:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-980925f8-faad-43e2-b07e-c1863e733fd5 tempest-VolumesActionsTest-1804509687 None] Lock "cinder-7bf388b9-262e-495d-827e-cc5691552318" released by "attach_volume" :: held 0.382s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:12:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b66d4fc3-ce37-4f1c-b2b0-8bfd8a5aa5b1 tempest-VolumesActionsTest-1804509687 None] Acquiring lock "cinder-7bf388b9-262e-495d-827e-cc5691552318-detach_volume" by "detach_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:12:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b66d4fc3-ce37-4f1c-b2b0-8bfd8a5aa5b1 tempest-VolumesActionsTest-1804509687 None] Lock "cinder-7bf388b9-262e-495d-827e-cc5691552318-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:12:08 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b66d4fc3-ce37-4f1c-b2b0-8bfd8a5aa5b1 tempest-VolumesActionsTest-1804509687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:12:08 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b66d4fc3-ce37-4f1c-b2b0-8bfd8a5aa5b1 tempest-VolumesActionsTest-1804509687 None] Detaching volume 7bf388b9-262e-495d-827e-cc5691552318 from instance 4e418183-5389-4377-b229-41c8e1a6b441.
Sep 18 01:12:08 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b66d4fc3-ce37-4f1c-b2b0-8bfd8a5aa5b1 tempest-VolumesActionsTest-1804509687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:12:08 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b66d4fc3-ce37-4f1c-b2b0-8bfd8a5aa5b1 tempest-VolumesActionsTest-1804509687 None] Detach volume completed successfully.
Sep 18 01:12:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b66d4fc3-ce37-4f1c-b2b0-8bfd8a5aa5b1 tempest-VolumesActionsTest-1804509687 None] Lock "cinder-7bf388b9-262e-495d-827e-cc5691552318-detach_volume" released by "detach_volume" :: held 0.149s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:12:18 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:12:18 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:INSERT=1,cinder:SELECT=7,cinder:UPDATE=3 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:12:21 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Flow 'volume_create_manager' (287f2bbb-e6aa-46d5-9093-cd6ebec771a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1181b609-25bc-475a-abb8-cf781fb93df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1181b609-25bc-475a-abb8-cf781fb93df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-815858594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d7439b-43ae-408e-981f-aee2ddf6d04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d86530b6314c26be10c1e1cedaa795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:12:21Z,use_quota=True,user_id='1d295ef68ee6488281c09162028ecb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3406b32b-ee83-4df2-9cdd-0966ac96870c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3406b32b-ee83-4df2-9cdd-0966ac96870c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0a6024-7905-4a73-b3c4-fba802c2f091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0a6024-7905-4a73-b3c4-fba802c2f091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d7439b-43ae-408e-981f-aee2ddf6d04a', 'volume_name': 'volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c630cee-652c-4372-8dd0-69364f960318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c630cee-652c-4372-8dd0-69364f960318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c56d4b3-ba9b-4f86-a615-d9ab559e1780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:12:21 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Volume f1d7439b-43ae-408e-981f-aee2ddf6d04a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a', 'volume_size': 1}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-815858594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d7439b-43ae-408e-981f-aee2ddf6d04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d86530b6314c26be10c1e1cedaa795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:12:21Z,use_quota=True,user_id='1d295ef68ee6488281c09162028ecb48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Creating volume f1d7439b-43ae-408e-981f-aee2ddf6d04a {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:12:21 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:12:21 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=80, name=volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a 1073741824" returned: 0 in 0.423s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a" returned: 0 in 0.147s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] <== create_volume: return (651ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:12:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:12:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c56d4b3-ba9b-4f86-a615-d9ab559e1780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:12:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16705de-0653-4207-a435-d9b71d9510ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:12:22 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Volume volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a (f1d7439b-43ae-408e-981f-aee2ddf6d04a): created successfully
Sep 18 01:12:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16705de-0653-4207-a435-d9b71d9510ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:12:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Flow 'volume_create_manager' (287f2bbb-e6aa-46d5-9093-cd6ebec771a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:12:22 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b070e37b-1a2f-46d9-af3f-ec6d30ff45eb tempest-TestMinimumBasicScenario-590835272 None] Created volume successfully.
Sep 18 01:12:27 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-0db8fc42-a49d-4466-9fdd-27301bc2a09c req-497d91f5-1436-435a-b301-d3e49904fee2 tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:12:27 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-0db8fc42-a49d-4466-9fdd-27301bc2a09c req-497d91f5-1436-435a-b301-d3e49904fee2 tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:12:27 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-0db8fc42-a49d-4466-9fdd-27301bc2a09c req-497d91f5-1436-435a-b301-d3e49904fee2 tempest-AttachVolumeNegativeTest-1787668276 None] Terminate volume connection completed successfully.
Sep 18 01:12:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-0db8fc42-a49d-4466-9fdd-27301bc2a09c req-497d91f5-1436-435a-b301-d3e49904fee2 tempest-AttachVolumeNegativeTest-1787668276 None] Deleting attachment ba8f0983-fc01-4dd5-8c89-ac70f5b03db4. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:12:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-4f5d0f2f-b178-4677-ae7c-5ba6c3a1d5b2 req-d03f695e-9d0b-49ab-96d3-db6191409c46 tempest-TestMinimumBasicScenario-590835272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:12:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-4f5d0f2f-b178-4677-ae7c-5ba6c3a1d5b2 req-d03f695e-9d0b-49ab-96d3-db6191409c46 tempest-TestMinimumBasicScenario-590835272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:12:29 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b59fed-51c1-4f2a-9e32-0ddf483ae5a0]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:12:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-4f5d0f2f-b178-4677-ae7c-5ba6c3a1d5b2 req-d03f695e-9d0b-49ab-96d3-db6191409c46 tempest-TestMinimumBasicScenario-590835272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:12:31 devstack quobyte-client[84147]: System call of process 94876 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:12:31 devstack quobyte-client[84147]: System call of process 94876 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:12:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-4f5d0f2f-b178-4677-ae7c-5ba6c3a1d5b2 req-d03f695e-9d0b-49ab-96d3-db6191409c46 tempest-TestMinimumBasicScenario-590835272 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a" returned: 0 in 1.470s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:12:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-4f5d0f2f-b178-4677-ae7c-5ba6c3a1d5b2 req-d03f695e-9d0b-49ab-96d3-db6191409c46 tempest-TestMinimumBasicScenario-590835272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.611s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:12:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-4f5d0f2f-b178-4677-ae7c-5ba6c3a1d5b2 req-d03f695e-9d0b-49ab-96d3-db6191409c46 tempest-TestMinimumBasicScenario-590835272 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9cc4a0b7-354d-4bae-8e5a-49bd5a905e90', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:12:31 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-4f5d0f2f-b178-4677-ae7c-5ba6c3a1d5b2 req-d03f695e-9d0b-49ab-96d3-db6191409c46 tempest-TestMinimumBasicScenario-590835272 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:12:32 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-4f5d0f2f-b178-4677-ae7c-5ba6c3a1d5b2 req-d03f695e-9d0b-49ab-96d3-db6191409c46 tempest-TestMinimumBasicScenario-590835272 None] attachment_update completed successfully.
Sep 18 01:12:42 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:12:42 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:12:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:12:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:12:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:12:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:12:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:12:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:12:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:12:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.315s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:12:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:13:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3ca78600-42e1-49e0-b07a-54e74c5dec68 tempest-VolumesActionsTest-1804509687 None] Acquiring lock "cinder-7bf388b9-262e-495d-827e-cc5691552318" by "attach_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:13:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3ca78600-42e1-49e0-b07a-54e74c5dec68 tempest-VolumesActionsTest-1804509687 None] Lock "cinder-7bf388b9-262e-495d-827e-cc5691552318" acquired by "attach_volume" :: waited 0.470s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:13:03 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3ca78600-42e1-49e0-b07a-54e74c5dec68 tempest-VolumesActionsTest-1804509687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:13:03 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3ca78600-42e1-49e0-b07a-54e74c5dec68 tempest-VolumesActionsTest-1804509687 None] Attaching volume 7bf388b9-262e-495d-827e-cc5691552318 to instance 7ab98399-59d7-4ce6-8ea3-b65021eede94 at mountpoint /dev/vdb on host None.
Sep 18 01:13:04 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3ca78600-42e1-49e0-b07a-54e74c5dec68 tempest-VolumesActionsTest-1804509687 None] Attach volume completed successfully.
Sep 18 01:13:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3ca78600-42e1-49e0-b07a-54e74c5dec68 tempest-VolumesActionsTest-1804509687 None] Lock "cinder-7bf388b9-262e-495d-827e-cc5691552318" released by "attach_volume" :: held 0.969s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:13:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2cd74b35-16e7-4b06-9351-a842ca9e8d96 tempest-VolumesActionsTest-1804509687 None] Acquiring lock "cinder-7bf388b9-262e-495d-827e-cc5691552318-detach_volume" by "detach_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:13:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2cd74b35-16e7-4b06-9351-a842ca9e8d96 tempest-VolumesActionsTest-1804509687 None] Lock "cinder-7bf388b9-262e-495d-827e-cc5691552318-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:13:05 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-2cd74b35-16e7-4b06-9351-a842ca9e8d96 tempest-VolumesActionsTest-1804509687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:13:05 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-2cd74b35-16e7-4b06-9351-a842ca9e8d96 tempest-VolumesActionsTest-1804509687 None] Detaching volume 7bf388b9-262e-495d-827e-cc5691552318 from instance 7ab98399-59d7-4ce6-8ea3-b65021eede94.
Sep 18 01:13:05 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-2cd74b35-16e7-4b06-9351-a842ca9e8d96 tempest-VolumesActionsTest-1804509687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:13:05 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-2cd74b35-16e7-4b06-9351-a842ca9e8d96 tempest-VolumesActionsTest-1804509687 None] Detach volume completed successfully.
Sep 18 01:13:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2cd74b35-16e7-4b06-9351-a842ca9e8d96 tempest-VolumesActionsTest-1804509687 None] Lock "cinder-7bf388b9-262e-495d-827e-cc5691552318-detach_volume" released by "detach_volume" :: held 0.243s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:13:15 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:INSERT=1,cinder:SELECT=4,cinder:UPDATE=4 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:13:15 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:13:20 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:13:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:13:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.015s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:13:20 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b8edc8-c8d7-4308-94d1-1f77b2a88df0]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:13:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:13:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318" returned: 0 in 0.570s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:13:20 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6800feb-35cc-4e33-a9eb-d1394d4d4b0c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:13:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:13:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318" returned: 0 in 0.660s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:13:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 /opt/stack/data/cinder/conversion/7bf388b9-262e-495d-827e-cc5691552318.temp_image.799a7fa6-3762-4c50-8ac2-35562c19d41d8vuz3_bo.img {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:13:26 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:13:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 /opt/stack/data/cinder/conversion/7bf388b9-262e-495d-827e-cc5691552318.temp_image.799a7fa6-3762-4c50-8ac2-35562c19d41d8vuz3_bo.img" returned: 0 in 7.623s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:13:29 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ecf47b-85c9-47f8-be9d-42d1fe0e8e82]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:13:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:13:30 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:13:31 devstack quobyte-client[84147]: System call of process 95660 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:13:31 devstack quobyte-client[84147]: System call of process 95660 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:13:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318" returned: 0 in 2.822s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:13:32 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] Image conversion details: src /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318, size 1024.00 MB, duration 7.66 sec, destination /opt/stack/data/cinder/conversion/7bf388b9-262e-495d-827e-cc5691552318.temp_image.799a7fa6-3762-4c50-8ac2-35562c19d41d8vuz3_bo.img {{(pid=84134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 01:13:32 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] Converted 1024.00 MB image at 133.75 MB/s
Sep 18 01:13:33 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] 799a7fa6-3762-4c50-8ac2-35562c19d41d was raw, no need to convert to raw {{(pid=84134) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 18 01:13:43 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:13:56 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:13:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:13:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:13:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:13:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:13:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:13:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:13:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.416s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:13:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:14:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 78.299s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:14:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] Uploaded volume to glance image-id: 799a7fa6-3762-4c50-8ac2-35562c19d41d. {{(pid=84134) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 18 01:14:38 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-105e0473-77d5-4686-96c6-798904e74dc4 tempest-VolumesActionsTest-1804509687 None] Copy volume to image completed successfully.
Sep 18 01:14:40 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:14:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:14:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:14:40 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[077870fb-8a23-4c02-b131-c64f2d54ade0]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:14:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:14:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318" returned: 0 in 0.602s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:14:41 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ecb6bb-21e2-45e1-8f7a-53176eaad315]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:14:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:14:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318" returned: 0 in 0.497s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:14:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 /opt/stack/data/cinder/conversion/7bf388b9-262e-495d-827e-cc5691552318.temp_image.9aab2857-47ff-46d8-830a-a9f8f956b98085to04zv.img {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:14:41 devstack quobyte-client[84147]: System call of process 95950 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:14:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 /opt/stack/data/cinder/conversion/7bf388b9-262e-495d-827e-cc5691552318.temp_image.9aab2857-47ff-46d8-830a-a9f8f956b98085to04zv.img" returned: 0 in 6.075s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:14:47 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[557dc1d0-29f5-414c-bb85-caaed7559e99]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:14:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:14:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318" returned: 0 in 0.580s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:14:48 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Image conversion details: src /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/conversion/7bf388b9-262e-495d-827e-cc5691552318.temp_image.9aab2857-47ff-46d8-830a-a9f8f956b98085to04zv.img {{(pid=84134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 01:14:48 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Converted 1024.00 MB image at 167.69 MB/s
Sep 18 01:14:48 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:14:48 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] 9aab2857-47ff-46d8-830a-a9f8f956b980 was raw, converting to qcow2 {{(pid=84134) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 18 01:14:49 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea257b86-7214-4e4b-93fe-188a7447c2a1]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:14:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7bf388b9-262e-495d-827e-cc5691552318.temp_image.9aab2857-47ff-46d8-830a-a9f8f956b98085to04zv.img {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:14:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7bf388b9-262e-495d-827e-cc5691552318.temp_image.9aab2857-47ff-46d8-830a-a9f8f956b98085to04zv.img" returned: 0 in 0.413s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:14:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7bf388b9-262e-495d-827e-cc5691552318.temp_image.9aab2857-47ff-46d8-830a-a9f8f956b98085to04zv.img {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:14:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7bf388b9-262e-495d-827e-cc5691552318.temp_image.9aab2857-47ff-46d8-830a-a9f8f956b98085to04zv.img" returned: 1 in 0.373s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:14:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7bf388b9-262e-495d-827e-cc5691552318.temp_image.9aab2857-47ff-46d8-830a-a9f8f956b98085to04zv.img' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:14:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7bf388b9-262e-495d-827e-cc5691552318.temp_image.9aab2857-47ff-46d8-830a-a9f8f956b98085to04zv.img /opt/stack/data/cinder/conversion/vol_upload_83bxl0ma {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:14:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7bf388b9-262e-495d-827e-cc5691552318.temp_image.9aab2857-47ff-46d8-830a-a9f8f956b98085to04zv.img /opt/stack/data/cinder/conversion/vol_upload_83bxl0ma" returned: 0 in 0.152s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:14:50 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Image conversion details: src /opt/stack/data/cinder/conversion/7bf388b9-262e-495d-827e-cc5691552318.temp_image.9aab2857-47ff-46d8-830a-a9f8f956b98085to04zv.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_83bxl0ma {{(pid=84134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 01:14:50 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 18 01:14:50 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec62ca7-5a7a-4246-a71d-215953153261]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:14:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_83bxl0ma {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:14:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_83bxl0ma" returned: 0 in 0.434s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:14:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.300s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:14:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Uploaded volume to glance image-id: 9aab2857-47ff-46d8-830a-a9f8f956b980. {{(pid=84134) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 18 01:14:52 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-2ce1d3d7-da77-46a1-b47f-f2d3efdbeec0 tempest-VolumesActionsTest-1804509687 None] Copy volume to image completed successfully.
Sep 18 01:14:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Acquiring lock "cinder-7bf388b9-262e-495d-827e-cc5691552318-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:14:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Lock "cinder-7bf388b9-262e-495d-827e-cc5691552318-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:14:53 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:14:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Acquiring lock "cinder-quobyte-7bf388b9-262e-495d-827e-cc5691552318" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:14:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Lock "cinder-quobyte-7bf388b9-262e-495d-827e-cc5691552318" acquired by "delete_volume" :: waited 0.022s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:14:53 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d508cd-6022-4489-b7ef-6a08ffdd6d8e]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:14:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:14:54 devstack quobyte-client[84147]: System call of process 95985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:14:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318" returned: 0 in 0.682s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:14:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:14:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-7bf388b9-262e-495d-827e-cc5691552318" returned: 0 in 0.501s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:14:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Lock "cinder-quobyte-7bf388b9-262e-495d-827e-cc5691552318" released by "delete_volume" :: held 2.083s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:14:55 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Flow 'volume_create_manager' (6201da85-6257-4846-8545-1823280b46df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7809233c-e693-4e4a-a99d-4fe7d4be6d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7809233c-e693-4e4a-a99d-4fe7d4be6d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-549973027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8624f5-3830-494e-bed4-97fc02a6ec79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6920fc1d0554b32beb791855050a1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:14:55Z,use_quota=True,user_id='432d409366d04016a55c80563699e1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258da4ef-897f-4f74-b2e2-b74a616edf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258da4ef-897f-4f74-b2e2-b74a616edf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3a8408-b99a-48f6-b351-b372c3a7514c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3a8408-b99a-48f6-b351-b372c3a7514c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d8624f5-3830-494e-bed4-97fc02a6ec79', 'volume_name': 'volume-4d8624f5-3830-494e-bed4-97fc02a6ec79', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ac82b5-8a64-4726-b439-0510b6c3f3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ac82b5-8a64-4726-b439-0510b6c3f3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859f34f7-63bd-41ee-a481-e3f853047e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:14:56 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Volume 4d8624f5-3830-494e-bed4-97fc02a6ec79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d8624f5-3830-494e-bed4-97fc02a6ec79', 'volume_size': 1}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-549973027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8624f5-3830-494e-bed4-97fc02a6ec79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6920fc1d0554b32beb791855050a1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:14:55Z,use_quota=True,user_id='432d409366d04016a55c80563699e1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Creating volume 4d8624f5-3830-494e-bed4-97fc02a6ec79 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:14:56 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:14:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d8624f5-3830-494e-bed4-97fc02a6ec79 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:14:56 devstack quobyte-client[84147]: System call of process 95997 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:14:56 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=81, name=volume-4d8624f5-3830-494e-bed4-97fc02a6ec79, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:14:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:14:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:14:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:14:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:14:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:14:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:14:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:14:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d8624f5-3830-494e-bed4-97fc02a6ec79 1073741824" returned: 0 in 1.313s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:14:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d8624f5-3830-494e-bed4-97fc02a6ec79 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:14:57 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Created reservations ['95abf559-d657-4030-881e-e8b6c63aab0b', '4d6a5cc4-6aa6-467d-ac20-b8a79a35109b', 'd5d5b815-95e1-4681-af38-8a32c7d41a67', 'e59d75b3-285b-4a7a-858f-1e9e860ca591'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:14:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.698s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:14:58 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:14:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d8624f5-3830-494e-bed4-97fc02a6ec79" returned: 0 in 0.558s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:14:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] <== create_volume: return (1953ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:14:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:14:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:14:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:14:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:14:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:14:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:14:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:14:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859f34f7-63bd-41ee-a481-e3f853047e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d8624f5-3830-494e-bed4-97fc02a6ec79', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:14:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f01de2-7d10-41e6-aa4e-29091ff244fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:14:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.566s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:14:59 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:14:59 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Volume volume-4d8624f5-3830-494e-bed4-97fc02a6ec79 (4d8624f5-3830-494e-bed4-97fc02a6ec79): created successfully
Sep 18 01:14:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f01de2-7d10-41e6-aa4e-29091ff244fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:14:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Flow 'volume_create_manager' (6201da85-6257-4846-8545-1823280b46df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:14:59 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Deleted volume successfully.
Sep 18 01:14:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-4e0c7135-d15b-4f8e-93b4-5a809c5b6676 tempest-VolumesActionsTest-1804509687 None] Lock "cinder-7bf388b9-262e-495d-827e-cc5691552318-delete_volume" released by "delete_volume" :: held 6.029s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:14:59 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3d565367-c267-45f5-acff-3e5e28ad0856 tempest-AttachVolumeNegativeTest-1787668276 None] Created volume successfully.
Sep 18 01:15:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-6fd7014d-ccd2-41ad-8cde-a0f8e278fe73 req-c7fc0bc1-b726-4292-9344-4e9e8c7c997c tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:15:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-6fd7014d-ccd2-41ad-8cde-a0f8e278fe73 req-c7fc0bc1-b726-4292-9344-4e9e8c7c997c tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.023s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:15:05 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[60086dde-9210-4136-bd29-017759dbe5b0]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:15:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-6fd7014d-ccd2-41ad-8cde-a0f8e278fe73 req-c7fc0bc1-b726-4292-9344-4e9e8c7c997c tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d8624f5-3830-494e-bed4-97fc02a6ec79 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:06 devstack quobyte-client[84147]: System call of process 96039 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:15:06 devstack quobyte-client[84147]: System call of process 96039 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:15:06 devstack quobyte-client[84147]: System call of process 96039 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:15:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-6fd7014d-ccd2-41ad-8cde-a0f8e278fe73 req-c7fc0bc1-b726-4292-9344-4e9e8c7c997c tempest-AttachVolumeNegativeTest-1787668276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d8624f5-3830-494e-bed4-97fc02a6ec79" returned: 0 in 0.936s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-6fd7014d-ccd2-41ad-8cde-a0f8e278fe73 req-c7fc0bc1-b726-4292-9344-4e9e8c7c997c tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.036s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:15:06 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-6fd7014d-ccd2-41ad-8cde-a0f8e278fe73 req-c7fc0bc1-b726-4292-9344-4e9e8c7c997c tempest-AttachVolumeNegativeTest-1787668276 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-4d8624f5-3830-494e-bed4-97fc02a6ec79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7dc220c-fba3-48da-bb0c-482a14f126e1', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:15:06 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-6fd7014d-ccd2-41ad-8cde-a0f8e278fe73 req-c7fc0bc1-b726-4292-9344-4e9e8c7c997c tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:15:07 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-6fd7014d-ccd2-41ad-8cde-a0f8e278fe73 req-c7fc0bc1-b726-4292-9344-4e9e8c7c997c tempest-AttachVolumeNegativeTest-1787668276 None] attachment_update completed successfully.
Sep 18 01:15:13 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Flow 'volume_create_manager' (6ea3c8cc-c7f7-43be-a454-1a3c45fbb232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de8e0ab-15d1-4ac3-8add-81897495469f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de8e0ab-15d1-4ac3-8add-81897495469f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2061743619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7f7fe2-e36b-4373-b35b-14f74b74909a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9fb5b87a2e4cc7b19393eeb8b09034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:15:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:15:13Z,use_quota=True,user_id='32e0bbe9844e4a5d868b87cb342fa61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43071011-e860-4018-a6e3-89229dacd0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43071011-e860-4018-a6e3-89229dacd0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f36afbf-00b7-45c8-ada4-c38f6acab650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f36afbf-00b7-45c8-ada4-c38f6acab650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7f7fe2-e36b-4373-b35b-14f74b74909a', 'volume_name': 'volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a', 'volume_size': 2}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9b7ea4-f7b4-465c-bba0-5c76480069f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9b7ea4-f7b4-465c-bba0-5c76480069f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f86554b-6674-4e81-86e1-135b8a2ac233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:15:13 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Volume ff7f7fe2-e36b-4373-b35b-14f74b74909a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a', 'volume_size': 2}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2061743619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7f7fe2-e36b-4373-b35b-14f74b74909a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9fb5b87a2e4cc7b19393eeb8b09034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:15:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:15:13Z,use_quota=True,user_id='32e0bbe9844e4a5d868b87cb342fa61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Creating volume ff7f7fe2-e36b-4373-b35b-14f74b74909a {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:15:13 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:15:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a 2147483648 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:13 devstack quobyte-client[84147]: System call of process 96087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:15:13 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=82, name=volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:15:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a 2147483648" returned: 0 in 0.755s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a" returned: 0 in 0.168s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] <== create_volume: return (1048ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:15:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:15:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f86554b-6674-4e81-86e1-135b8a2ac233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a', 'volume_size': 2}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:15:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a6da1e-7cbe-4cd3-9fc7-f35dc1ceedd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:15:14 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Volume volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a (ff7f7fe2-e36b-4373-b35b-14f74b74909a): created successfully
Sep 18 01:15:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a6da1e-7cbe-4cd3-9fc7-f35dc1ceedd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:15:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Flow 'volume_create_manager' (6ea3c8cc-c7f7-43be-a454-1a3c45fbb232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:15:15 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e5347822-a23d-4fb9-b595-696c56675e7e tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Created volume successfully.
Sep 18 01:15:15 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:15:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:15:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:15:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Creating offline snapshot 85b7197d-5315-4686-b310-c19f9129ae28 of volume ff7f7fe2-e36b-4373-b35b-14f74b74909a {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:15:15 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b969538f-479b-4dad-8bf0-5f03cb98fca7]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:15:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:16 devstack quobyte-client[84147]: System call of process 96097 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:15:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a" returned: 0 in 1.024s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28 2G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:17 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=83, name=volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:15:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28 2G" returned: 0 in 0.426s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "qemu-img rebase -u -b volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28" returned: 0 in 0.211s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:15:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28" returned: 0 in 0.213s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:18 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:15:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28" returned: 0 in 0.101s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.info" returned: 0 in 0.095s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:18 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:15:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.info" returned: 0 in 0.081s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.581s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:15:18 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-16680d52-7355-41aa-bc98-0b1f7a11d535 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Create snapshot completed successfully
Sep 18 01:15:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Acquiring lock "cinder-85b7197d-5315-4686-b310-c19f9129ae28-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:15:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "cinder-85b7197d-5315-4686-b310-c19f9129ae28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:15:19 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:15:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Acquiring lock "cinder-quobyte-ff7f7fe2-e36b-4373-b35b-14f74b74909a" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:15:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "cinder-quobyte-ff7f7fe2-e36b-4373-b35b-14f74b74909a" acquired by "delete_snapshot" :: waited 0.008s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:15:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Acquiring lock "cinder-quobyte-85b7197d-5315-4686-b310-c19f9129ae28" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:15:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "cinder-quobyte-85b7197d-5315-4686-b310-c19f9129ae28" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:15:19 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Deleting offline snapshot 85b7197d-5315-4686-b310-c19f9129ae28 of volume ff7f7fe2-e36b-4373-b35b-14f74b74909a {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:15:19 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] snapshot_file for this snap is: volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:15:19 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc49222-3134-48e3-9b32-637c070062df]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:15:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28" returned: 0 in 0.370s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:19 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:15:19 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[964defe7-646c-40ce-9782-badee3843491]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:15:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a" returned: 0 in 0.447s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28" returned: 0 in 0.199s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a.85b7197d-5315-4686-b310-c19f9129ae28" returned: 0 in 0.093s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "cinder-quobyte-85b7197d-5315-4686-b310-c19f9129ae28" released by "_delete_snapshot" :: held 1.390s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:15:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "cinder-quobyte-ff7f7fe2-e36b-4373-b35b-14f74b74909a" released by "delete_snapshot" :: held 1.408s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:15:20 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Created reservations ['e49a7011-8328-430b-a3d9-03b129ea23a4', 'e5a5bbee-6f75-4905-aae0-0b357312e90c', '56ab639a-7c96-4fec-a61b-f66700eda211', '53f8c5d3-0662-42dc-a2f2-33b031e2f79d'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:15:21 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Delete snapshot completed successfully.
Sep 18 01:15:21 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-27d3b20a-079a-4558-a57e-6b9c98c3c86f tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "cinder-85b7197d-5315-4686-b310-c19f9129ae28-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:15:21 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Acquiring lock "cinder-ff7f7fe2-e36b-4373-b35b-14f74b74909a-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:15:21 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "cinder-ff7f7fe2-e36b-4373-b35b-14f74b74909a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:15:21 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:15:21 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Acquiring lock "cinder-quobyte-ff7f7fe2-e36b-4373-b35b-14f74b74909a" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:15:21 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "cinder-quobyte-ff7f7fe2-e36b-4373-b35b-14f74b74909a" acquired by "delete_volume" :: waited 0.012s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:15:21 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[28620d06-f0a1-4860-82cf-94a6113f47e2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:15:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a" returned: 0 in 0.402s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ff7f7fe2-e36b-4373-b35b-14f74b74909a" returned: 0 in 0.111s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:22 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "cinder-quobyte-ff7f7fe2-e36b-4373-b35b-14f74b74909a" released by "delete_volume" :: held 0.664s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:15:22 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Created reservations ['2df15554-ade3-4d65-a5a6-81b361e8623c', '5936e3c4-894a-4007-9ecb-c5b036eb75cb', '3e9f0a01-1877-422e-afdb-1aacef4db391', 'c44a1a47-f42b-4aa4-8284-9ac878d5c2c3'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:15:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:15:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:15:22 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:15:22 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:15:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:15:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.104s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:22 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:15:22 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Deleted volume successfully.
Sep 18 01:15:23 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6096c2c3-ec07-4e58-acaf-66135f4510a7 tempest-VolumesSnapshotNegativeTestJSON-1542246955 None] Lock "cinder-ff7f7fe2-e36b-4373-b35b-14f74b74909a-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:15:32 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=35,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=3 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:15:32 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=18,cinder:UPDATE=34,cinder:DELETE=2,cinder:INSERT=4 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:15:36 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-cdf1c772-7776-4519-a49e-c52da8b51b7b req-e6ebea81-995d-48e2-a1de-be1ee52cb25d tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:15:36 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-cdf1c772-7776-4519-a49e-c52da8b51b7b req-e6ebea81-995d-48e2-a1de-be1ee52cb25d tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:15:36 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-cdf1c772-7776-4519-a49e-c52da8b51b7b req-e6ebea81-995d-48e2-a1de-be1ee52cb25d tempest-AttachVolumeNegativeTest-1787668276 None] Terminate volume connection completed successfully.
Sep 18 01:15:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-cdf1c772-7776-4519-a49e-c52da8b51b7b req-e6ebea81-995d-48e2-a1de-be1ee52cb25d tempest-AttachVolumeNegativeTest-1787668276 None] Deleting attachment e7dc220c-fba3-48da-bb0c-482a14f126e1. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:15:38 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-4b2a3bf6-79c2-44af-aa25-44b98661ca9e req-d99effe6-d483-4344-ac17-7f34ef4f376c tempest-TestMinimumBasicScenario-590835272 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:15:38 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-4b2a3bf6-79c2-44af-aa25-44b98661ca9e req-d99effe6-d483-4344-ac17-7f34ef4f376c tempest-TestMinimumBasicScenario-590835272 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:15:38 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-4b2a3bf6-79c2-44af-aa25-44b98661ca9e req-d99effe6-d483-4344-ac17-7f34ef4f376c tempest-TestMinimumBasicScenario-590835272 None] Terminate volume connection completed successfully.
Sep 18 01:15:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-4b2a3bf6-79c2-44af-aa25-44b98661ca9e req-d99effe6-d483-4344-ac17-7f34ef4f376c tempest-TestMinimumBasicScenario-590835272 None] Deleting attachment 9cc4a0b7-354d-4bae-8e5a-49bd5a905e90. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:15:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Acquiring lock "cinder-f1d7439b-43ae-408e-981f-aee2ddf6d04a-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:15:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Lock "cinder-f1d7439b-43ae-408e-981f-aee2ddf6d04a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:15:40 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:15:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Acquiring lock "cinder-quobyte-f1d7439b-43ae-408e-981f-aee2ddf6d04a" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:15:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Lock "cinder-quobyte-f1d7439b-43ae-408e-981f-aee2ddf6d04a" acquired by "delete_volume" :: waited 0.017s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:15:40 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf197054-94fa-4996-af5c-cdd77bb44413]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:15:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a" returned: 0 in 0.591s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f1d7439b-43ae-408e-981f-aee2ddf6d04a" returned: 0 in 0.099s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:41 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Lock "cinder-quobyte-f1d7439b-43ae-408e-981f-aee2ddf6d04a" released by "delete_volume" :: held 0.889s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:15:42 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Created reservations ['4960f44e-98da-4e29-95b2-84d42e469118', '47a57979-45ba-4775-9b94-49730609cdff', 'a49ccad4-7ec6-4063-964a-502daed41761', 'bb311911-a854-4f2e-8f42-8759d6601d22'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:15:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:15:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:15:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:15:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:15:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:15:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.225s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:42 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:15:42 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Deleted volume successfully.
Sep 18 01:15:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7f88f73e-7784-4a4c-885d-cee7cf6570b8 tempest-TestMinimumBasicScenario-590835272 None] Lock "cinder-f1d7439b-43ae-408e-981f-aee2ddf6d04a-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:15:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "cinder-4d8624f5-3830-494e-bed4-97fc02a6ec79-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:15:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "cinder-4d8624f5-3830-494e-bed4-97fc02a6ec79-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:15:50 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:15:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "cinder-quobyte-4d8624f5-3830-494e-bed4-97fc02a6ec79" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:15:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "cinder-quobyte-4d8624f5-3830-494e-bed4-97fc02a6ec79" acquired by "delete_volume" :: waited 0.019s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:15:50 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8545f8-f781-4099-b42c-7bba241e17a2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:15:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d8624f5-3830-494e-bed4-97fc02a6ec79 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:51 devstack quobyte-client[84147]: System call of process 96239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:15:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d8624f5-3830-494e-bed4-97fc02a6ec79" returned: 0 in 0.596s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d8624f5-3830-494e-bed4-97fc02a6ec79 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d8624f5-3830-494e-bed4-97fc02a6ec79" returned: 0 in 0.096s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "cinder-quobyte-4d8624f5-3830-494e-bed4-97fc02a6ec79" released by "delete_volume" :: held 0.914s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:15:51 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Created reservations ['9a241dfe-8930-4881-a216-88ec468f8162', '6ecfcac0-9601-4dc1-9b45-96fd5c4a34a6', '01e8954c-d605-4364-bb42-53840cbe715e', '11562e6d-bed5-469a-82fe-8915f42be177'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:15:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:15:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:15:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:15:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:15:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:15:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.338s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:52 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:15:52 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Deleted volume successfully.
Sep 18 01:15:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3195ca75-762d-4144-9cde-4f254e40a692 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "cinder-4d8624f5-3830-494e-bed4-97fc02a6ec79-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:15:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "cinder-9497e20f-a203-48a6-802d-2a3bd8a5eee8-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:15:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Lock "cinder-9497e20f-a203-48a6-802d-2a3bd8a5eee8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:15:53 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:15:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "cinder-quobyte-9497e20f-a203-48a6-802d-2a3bd8a5eee8" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:15:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Lock "cinder-quobyte-9497e20f-a203-48a6-802d-2a3bd8a5eee8" acquired by "delete_volume" :: waited 0.019s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:15:53 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baf8c90-adaa-4a63-95b4-60feb69b1390]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:15:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:54 devstack quobyte-client[84147]: System call of process 96245 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:15:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8" returned: 0 in 1.011s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9497e20f-a203-48a6-802d-2a3bd8a5eee8" returned: 0 in 0.212s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Lock "cinder-quobyte-9497e20f-a203-48a6-802d-2a3bd8a5eee8" released by "delete_volume" :: held 1.498s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:15:55 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Created reservations ['e47e5f7b-1265-492a-ab58-4d92f5664172', 'd4fa0831-cdc2-4c08-a571-841abadf7214', '90adcd44-934b-47c7-9a95-7861645ba0b9', '6739a53f-ebf0-440e-9140-4f349fd5acae'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:15:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:15:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:15:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:15:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:15:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:15:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.149s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:55 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:15:55 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Deleted volume successfully.
Sep 18 01:15:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "cinder-bf7f1747-f745-4da8-81a6-e57b00bba1e2-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:15:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-688094ca-f2b1-4aa6-985a-8c774468a7cf tempest-AttachVolumeNegativeTest-1787668276 None] Lock "cinder-9497e20f-a203-48a6-802d-2a3bd8a5eee8-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:15:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "cinder-bf7f1747-f745-4da8-81a6-e57b00bba1e2-delete_volume" acquired by "delete_volume" :: waited 0.205s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:15:56 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:15:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "cinder-quobyte-bf7f1747-f745-4da8-81a6-e57b00bba1e2" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:15:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "cinder-quobyte-bf7f1747-f745-4da8-81a6-e57b00bba1e2" acquired by "delete_volume" :: waited 0.020s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:15:56 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53dce11-5825-4c0d-b052-5387054ab5e6]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:15:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:15:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:15:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:15:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:15:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:15:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:15:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2" returned: 0 in 0.784s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.352s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:15:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bf7f1747-f745-4da8-81a6-e57b00bba1e2" returned: 0 in 0.282s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "cinder-quobyte-bf7f1747-f745-4da8-81a6-e57b00bba1e2" released by "delete_volume" :: held 1.242s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:15:58 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Created reservations ['7ffe2db6-b946-4b8f-9c97-990365c5fd41', '90c32034-7b5f-4249-8ccc-793b9474f4da', '439de383-6cd1-4d01-b945-ff4d63a44367', '1533fb9c-595f-45cb-857d-52426231db0d'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:15:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:15:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:15:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:15:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:15:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:15:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:15:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.106s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:15:58 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:15:58 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Deleted volume successfully.
Sep 18 01:15:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-603e9f66-eeda-45e8-99c1-6c88a06bed73 tempest-AttachVolumeNegativeTest-1787668276 None] Lock "cinder-bf7f1747-f745-4da8-81a6-e57b00bba1e2-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:16:08 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=26,cinder:UPDATE=32,cinder:DELETE=2,cinder:INSERT=7 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:16:08 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=18,cinder:INSERT=9,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:16:14 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b250db58-8a29-4f2d-8750-a0878eb4e013 tempest-GroupSnapshotsV319Test-814295482 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:14 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b250db58-8a29-4f2d-8750-a0878eb4e013 tempest-GroupSnapshotsV319Test-814295482 None] Group tempest-GroupSnapshotsV319Test-Group-1473951270: creating
Sep 18 01:16:14 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b250db58-8a29-4f2d-8750-a0878eb4e013 tempest-GroupSnapshotsV319Test-814295482 None] Group tempest-GroupSnapshotsV319Test-Group-1473951270: created successfully
Sep 18 01:16:14 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b250db58-8a29-4f2d-8750-a0878eb4e013 tempest-GroupSnapshotsV319Test-814295482 None] Create group completed successfully.
Sep 18 01:16:15 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Flow 'volume_create_manager' (216541d1-7963-4bc2-890b-fcdb83f4a60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0375d706-bb72-4c65-8714-0647578c37b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0375d706-bb72-4c65-8714-0647578c37b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1300971200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b75ded3f-34d0-44b3-856d-a950c4148d9c,host='devstack@QuobyteHD#QuobyteHD',id=46c0494d-8e5f-4110-b2e9-d296c558b3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515676be9a7b490384735b3e282eba0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:16Z,use_quota=True,user_id='c27f392b0f6d479fb452adb14aa6ba95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d5afde-562c-4e45-aecf-78162d5e518a),volume_type_id=15d5afde-562c-4e45-aecf-78162d5e518a)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6f98f2-98c0-480d-b808-3e2d96381adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6f98f2-98c0-480d-b808-3e2d96381adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a6758a-ea29-40da-a531-aea629db5b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a6758a-ea29-40da-a531-aea629db5b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c0494d-8e5f-4110-b2e9-d296c558b3be', 'volume_name': 'volume-46c0494d-8e5f-4110-b2e9-d296c558b3be', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d08e6b1-1972-4e4d-a9a3-971a5e285b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d08e6b1-1972-4e4d-a9a3-971a5e285b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bb751b-ad29-492b-a2f5-4f23ebfe147c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:15 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Volume 46c0494d-8e5f-4110-b2e9-d296c558b3be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c0494d-8e5f-4110-b2e9-d296c558b3be', 'volume_size': 1}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b75ded3f-34d0-44b3-856d-a950c4148d9c,created_at=2025-09-17T23:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1300971200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b75ded3f-34d0-44b3-856d-a950c4148d9c,host='devstack@QuobyteHD#QuobyteHD',id=46c0494d-8e5f-4110-b2e9-d296c558b3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515676be9a7b490384735b3e282eba0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:16Z,use_quota=True,user_id='c27f392b0f6d479fb452adb14aa6ba95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d5afde-562c-4e45-aecf-78162d5e518a),volume_type_id=15d5afde-562c-4e45-aecf-78162d5e518a)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Creating volume 46c0494d-8e5f-4110-b2e9-d296c558b3be {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:16:15 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:16:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:16 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=85, name=volume-46c0494d-8e5f-4110-b2e9-d296c558b3be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:16:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be 1073741824" returned: 0 in 0.450s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be" returned: 0 in 0.185s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:16 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] <== create_volume: return (715ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:16:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:16 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bb751b-ad29-492b-a2f5-4f23ebfe147c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c0494d-8e5f-4110-b2e9-d296c558b3be', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:16 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6289df6-ac71-4ff1-86de-e3b7c38cdf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:16 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Volume volume-46c0494d-8e5f-4110-b2e9-d296c558b3be (46c0494d-8e5f-4110-b2e9-d296c558b3be): created successfully
Sep 18 01:16:16 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6289df6-ac71-4ff1-86de-e3b7c38cdf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:16 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Flow 'volume_create_manager' (216541d1-7963-4bc2-890b-fcdb83f4a60a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:16 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-28afad9b-ae06-449e-8806-dd27dc4023ca tempest-GroupSnapshotsV319Test-814295482 None] Created volume successfully.
Sep 18 01:16:17 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Flow 'volume_create_manager' (f09bf7a6-4387-4f55-a2c5-29d26452890f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e57f08-f17c-4261-959e-73dbef9e121c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e57f08-f17c-4261-959e-73dbef9e121c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-612666599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a1bbd9-7063-4aac-8918-f6d081a9fad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a68e0bfebbc4126ab87383b872d3352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:17Z,use_quota=True,user_id='2176bfa1608e40c799e16fb218e8cab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f987ba-9a99-4fa2-a304-7e17296ee3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f987ba-9a99-4fa2-a304-7e17296ee3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b92206-68b5-49a2-95ab-aa655fb73c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b92206-68b5-49a2-95ab-aa655fb73c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a1bbd9-7063-4aac-8918-f6d081a9fad1', 'volume_name': 'volume-47a1bbd9-7063-4aac-8918-f6d081a9fad1', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df9cdf9-1c70-4c65-8f65-f32a71088a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df9cdf9-1c70-4c65-8f65-f32a71088a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a18f41-62a5-4b00-8520-fb31d946a554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:17 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Volume 47a1bbd9-7063-4aac-8918-f6d081a9fad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a1bbd9-7063-4aac-8918-f6d081a9fad1', 'volume_size': 1}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-612666599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a1bbd9-7063-4aac-8918-f6d081a9fad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a68e0bfebbc4126ab87383b872d3352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:17Z,use_quota=True,user_id='2176bfa1608e40c799e16fb218e8cab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Creating volume 47a1bbd9-7063-4aac-8918-f6d081a9fad1 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:16:17 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:16:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-47a1bbd9-7063-4aac-8918-f6d081a9fad1 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:17 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=86, name=volume-47a1bbd9-7063-4aac-8918-f6d081a9fad1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:16:18 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:18 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:16:18 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Flow 'volume_create_manager' (7841ca61-83d3-4fb8-8f29-c1479f7451fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:18 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f50f60-56df-48c1-b8e0-ec1efa9c3d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-47a1bbd9-7063-4aac-8918-f6d081a9fad1 1073741824" returned: 0 in 1.358s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-47a1bbd9-7063-4aac-8918-f6d081a9fad1 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:19 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] GroupSnapshot 4479a150-0cda-4f18-a228-eb4e89fa863f: creating.
Sep 18 01:16:20 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:20 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Flow 'volume_create_manager' (20b1e317-ec10-416d-97da-e34b1d548d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a89f696-3823-4512-a0d5-6426b6aaa841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f50f60-56df-48c1-b8e0-ec1efa9c3d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-8404537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f478cb8a-8d87-4c84-a716-fd0b4a821bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a68e0bfebbc4126ab87383b872d3352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:18Z,use_quota=True,user_id='2176bfa1608e40c799e16fb218e8cab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5d7349-0341-4724-bc49-7c73665358dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5d7349-0341-4724-bc49-7c73665358dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b92be0-20c5-4998-be7e-7983c4c0d9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b92be0-20c5-4998-be7e-7983c4c0d9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f478cb8a-8d87-4c84-a716-fd0b4a821bd2', 'volume_name': 'volume-f478cb8a-8d87-4c84-a716-fd0b4a821bd2', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042a1e68-5abb-46fc-9da0-ef62176c9ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042a1e68-5abb-46fc-9da0-ef62176c9ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8925e31c-e964-45be-8071-40aeb3626704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:21 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Volume f478cb8a-8d87-4c84-a716-fd0b4a821bd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f478cb8a-8d87-4c84-a716-fd0b4a821bd2', 'volume_size': 1}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:21 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] Group snapshot 4479a150-0cda-4f18-a228-eb4e89fa863f: creating. {{(pid=84134) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a89f696-3823-4512-a0d5-6426b6aaa841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1025481164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2adf3d-be84-4c6f-9257-73e956d7e9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a68e0bfebbc4126ab87383b872d3352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:18Z,use_quota=True,user_id='2176bfa1608e40c799e16fb218e8cab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444c98ab-fb81-424d-9395-35fe8da4bd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444c98ab-fb81-424d-9395-35fe8da4bd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8913063a-2f81-4b0d-9aa2-1467af543ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8913063a-2f81-4b0d-9aa2-1467af543ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea2adf3d-be84-4c6f-9257-73e956d7e9e6', 'volume_name': 'volume-ea2adf3d-be84-4c6f-9257-73e956d7e9e6', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf9554b-ff28-49f3-84d5-8351c08309f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf9554b-ff28-49f3-84d5-8351c08309f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c3d8a55-4959-4930-8cce-5b51b8ace5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:21 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Volume ea2adf3d-be84-4c6f-9257-73e956d7e9e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea2adf3d-be84-4c6f-9257-73e956d7e9e6', 'volume_size': 1}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-47a1bbd9-7063-4aac-8918-f6d081a9fad1" returned: 0 in 2.657s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] <== create_volume: return (4055ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.061s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:21 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Flow 'volume_create_manager' (8ed6a601-72d0-463a-85e8-9a3311b2d84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b7200e-0256-4ae8-8198-5ca1f375aa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.194s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-8404537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f478cb8a-8d87-4c84-a716-fd0b4a821bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a68e0bfebbc4126ab87383b872d3352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:18Z,use_quota=True,user_id='2176bfa1608e40c799e16fb218e8cab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Creating volume f478cb8a-8d87-4c84-a716-fd0b4a821bd2 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:16:21 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f478cb8a-8d87-4c84-a716-fd0b4a821bd2 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:21 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=87, name=volume-f478cb8a-8d87-4c84-a716-fd0b4a821bd2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b7200e-0256-4ae8-8198-5ca1f375aa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-743426995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f741e8-0716-432e-ac5e-9ef9b5836569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a68e0bfebbc4126ab87383b872d3352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:19Z,use_quota=True,user_id='2176bfa1608e40c799e16fb218e8cab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebabe122-82d2-4889-8ac5-120cb3805a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebabe122-82d2-4889-8ac5-120cb3805a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9579611-d5b9-486c-9652-5f133d85dc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9579611-d5b9-486c-9652-5f133d85dc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59f741e8-0716-432e-ac5e-9ef9b5836569', 'volume_name': 'volume-59f741e8-0716-432e-ac5e-9ef9b5836569', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bff36d8-1d47-40de-87d0-d29d45208c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bff36d8-1d47-40de-87d0-d29d45208c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d46f5c-3c1e-4a2b-a172-bbedab748a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:22 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Volume 59f741e8-0716-432e-ac5e-9ef9b5836569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59f741e8-0716-432e-ac5e-9ef9b5836569', 'volume_size': 1}
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a18f41-62a5-4b00-8520-fb31d946a554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a1bbd9-7063-4aac-8918-f6d081a9fad1', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50432b40-4eba-40cd-966c-33ff413cdda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:22 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Volume volume-47a1bbd9-7063-4aac-8918-f6d081a9fad1 (47a1bbd9-7063-4aac-8918-f6d081a9fad1): created successfully
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50432b40-4eba-40cd-966c-33ff413cdda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Flow 'volume_create_manager' (f09bf7a6-4387-4f55-a2c5-29d26452890f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f478cb8a-8d87-4c84-a716-fd0b4a821bd2 1073741824" returned: 0 in 0.890s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f478cb8a-8d87-4c84-a716-fd0b4a821bd2 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:22 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Flow 'volume_create_manager' (e6469448-736d-4a2e-aa7d-b50f299271d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:22 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa94edd-fad6-432b-8735-639d55c3580c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:23 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-55eba2e1-9b67-4d45-b99a-f22da14ab7ba tempest-CreateVolumesFromImageTest-433981544 None] Created volume successfully.
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa94edd-fad6-432b-8735-639d55c3580c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1988333929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a176c9e-c03c-431f-9712-4111c6305e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a68e0bfebbc4126ab87383b872d3352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:20Z,use_quota=True,user_id='2176bfa1608e40c799e16fb218e8cab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b01461-12aa-4ad4-a536-5b70c0a99cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b01461-12aa-4ad4-a536-5b70c0a99cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81e6aed-590e-459c-beee-5c4156e4571c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81e6aed-590e-459c-beee-5c4156e4571c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a176c9e-c03c-431f-9712-4111c6305e3a', 'volume_name': 'volume-0a176c9e-c03c-431f-9712-4111c6305e3a', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f8804c-117a-4bf9-996c-67c5e6fec33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f8804c-117a-4bf9-996c-67c5e6fec33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9761bc4-94ef-48b9-be09-747b26ad28db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:23 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Volume 0a176c9e-c03c-431f-9712-4111c6305e3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a176c9e-c03c-431f-9712-4111c6305e3a', 'volume_size': 1}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f478cb8a-8d87-4c84-a716-fd0b4a821bd2" returned: 0 in 1.068s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] <== create_volume: return (1981ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.088s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1025481164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2adf3d-be84-4c6f-9257-73e956d7e9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a68e0bfebbc4126ab87383b872d3352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:18Z,use_quota=True,user_id='2176bfa1608e40c799e16fb218e8cab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Creating volume ea2adf3d-be84-4c6f-9257-73e956d7e9e6 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:16:23 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:16:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ea2adf3d-be84-4c6f-9257-73e956d7e9e6 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:23 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=88, name=volume-ea2adf3d-be84-4c6f-9257-73e956d7e9e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:16:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8925e31c-e964-45be-8071-40aeb3626704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f478cb8a-8d87-4c84-a716-fd0b4a821bd2', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94c5da6-1b2e-46a9-a63d-82b38840b170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ea2adf3d-be84-4c6f-9257-73e956d7e9e6 1073741824" returned: 0 in 0.746s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ea2adf3d-be84-4c6f-9257-73e956d7e9e6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:24 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Volume volume-f478cb8a-8d87-4c84-a716-fd0b4a821bd2 (f478cb8a-8d87-4c84-a716-fd0b4a821bd2): created successfully
Sep 18 01:16:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94c5da6-1b2e-46a9-a63d-82b38840b170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Flow 'volume_create_manager' (7841ca61-83d3-4fb8-8f29-c1479f7451fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ea2adf3d-be84-4c6f-9257-73e956d7e9e6" returned: 0 in 0.410s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] <== create_volume: return (1204ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:16:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.317s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:24 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8751f9ae-358d-4c2b-aad6-979db81d4a94 tempest-CreateVolumesFromImageTest-433981544 None] Created volume successfully.
Sep 18 01:16:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c3d8a55-4959-4930-8cce-5b51b8ace5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea2adf3d-be84-4c6f-9257-73e956d7e9e6', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1919cb9a-234f-4e6b-bf03-d339ac316699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:25 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Volume volume-ea2adf3d-be84-4c6f-9257-73e956d7e9e6 (ea2adf3d-be84-4c6f-9257-73e956d7e9e6): created successfully
Sep 18 01:16:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1919cb9a-234f-4e6b-bf03-d339ac316699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Flow 'volume_create_manager' (20b1e317-ec10-416d-97da-e34b1d548d8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] Creating offline snapshot 0d925236-93e3-431a-8cd8-2ae085ef6de3 of volume 46c0494d-8e5f-4110-b2e9-d296c558b3be {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:16:25 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-82903c6a-c403-41d9-9e5d-91d2977759ae tempest-CreateVolumesFromImageTest-433981544 None] Created volume successfully.
Sep 18 01:16:25 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aec936-f5c8-4ed8-b23f-0fbbe551dbcd]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:16:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be" returned: 0 in 0.492s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:25 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=89, name=volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:16:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3 1G" returned: 0 in 0.221s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): qemu-img rebase -u -b volume-46c0494d-8e5f-4110-b2e9-d296c558b3be -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] CMD "qemu-img rebase -u -b volume-46c0494d-8e5f-4110-b2e9-d296c558b3be -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3" returned: 0 in 0.146s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3" returned: 0 in 0.148s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3" returned: 0 in 0.155s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.info" returned: 0 in 0.113s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.info" returned: 0 in 0.091s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.842s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-743426995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f741e8-0716-432e-ac5e-9ef9b5836569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a68e0bfebbc4126ab87383b872d3352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:19Z,use_quota=True,user_id='2176bfa1608e40c799e16fb218e8cab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Creating volume 59f741e8-0716-432e-ac5e-9ef9b5836569 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:16:26 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:16:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-59f741e8-0716-432e-ac5e-9ef9b5836569 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:27 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=91, name=volume-59f741e8-0716-432e-ac5e-9ef9b5836569, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-59f741e8-0716-432e-ac5e-9ef9b5836569 1073741824" returned: 0 in 0.486s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-59f741e8-0716-432e-ac5e-9ef9b5836569 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-59f741e8-0716-432e-ac5e-9ef9b5836569" returned: 0 in 0.443s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] <== create_volume: return (996ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.443s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1988333929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a176c9e-c03c-431f-9712-4111c6305e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a68e0bfebbc4126ab87383b872d3352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:20Z,use_quota=True,user_id='2176bfa1608e40c799e16fb218e8cab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Creating volume 0a176c9e-c03c-431f-9712-4111c6305e3a {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:16:27 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:16:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0a176c9e-c03c-431f-9712-4111c6305e3a 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:28 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=92, name=volume-0a176c9e-c03c-431f-9712-4111c6305e3a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:16:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d46f5c-3c1e-4a2b-a172-bbedab748a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59f741e8-0716-432e-ac5e-9ef9b5836569', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6f14ff-1178-4dc4-abfb-416b6903e8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:28 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-6ae0947c-ed6e-4612-ae66-f106f09d6224 tempest-GroupSnapshotsV319Test-814295482 None] group_snapshot 4479a150-0cda-4f18-a228-eb4e89fa863f: created successfully
Sep 18 01:16:28 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Volume volume-59f741e8-0716-432e-ac5e-9ef9b5836569 (59f741e8-0716-432e-ac5e-9ef9b5836569): created successfully
Sep 18 01:16:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6f14ff-1178-4dc4-abfb-416b6903e8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Flow 'volume_create_manager' (8ed6a601-72d0-463a-85e8-9a3311b2d84d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0a176c9e-c03c-431f-9712-4111c6305e3a 1073741824" returned: 0 in 0.567s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0a176c9e-c03c-431f-9712-4111c6305e3a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0a176c9e-c03c-431f-9712-4111c6305e3a" returned: 0 in 0.286s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] <== create_volume: return (996ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:16:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:29 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-2f27789e-1b97-4f76-bb6f-7daa2239dbb0 tempest-CreateVolumesFromImageTest-433981544 None] Created volume successfully.
Sep 18 01:16:29 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9761bc4-94ef-48b9-be09-747b26ad28db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a176c9e-c03c-431f-9712-4111c6305e3a', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:29 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8d1aa2-8ef9-493d-904d-d76dbc4ec578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:29 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Volume volume-0a176c9e-c03c-431f-9712-4111c6305e3a (0a176c9e-c03c-431f-9712-4111c6305e3a): created successfully
Sep 18 01:16:29 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8d1aa2-8ef9-493d-904d-d76dbc4ec578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:29 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Flow 'volume_create_manager' (e6469448-736d-4a2e-aa7d-b50f299271d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:29 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] group_snapshot 4479a150-0cda-4f18-a228-eb4e89fa863f: deleting
Sep 18 01:16:29 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e03e2cf6-e9f5-43fe-99be-2c8ec6bb964d tempest-CreateVolumesFromImageTest-433981544 None] Created volume successfully.
Sep 18 01:16:29 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:29 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] group_snapshot 4479a150-0cda-4f18-a228-eb4e89fa863f: deleting {{(pid=84134) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 01:16:29 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Acquiring lock "cinder-quobyte-46c0494d-8e5f-4110-b2e9-d296c558b3be" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:16:29 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Lock "cinder-quobyte-46c0494d-8e5f-4110-b2e9-d296c558b3be" acquired by "delete_snapshot" :: waited 0.061s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:16:29 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Acquiring lock "cinder-quobyte-0d925236-93e3-431a-8cd8-2ae085ef6de3" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:16:29 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Lock "cinder-quobyte-0d925236-93e3-431a-8cd8-2ae085ef6de3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:16:29 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Deleting offline snapshot 0d925236-93e3-431a-8cd8-2ae085ef6de3 of volume 46c0494d-8e5f-4110-b2e9-d296c558b3be {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:16:29 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] snapshot_file for this snap is: volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:16:29 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[af32d311-4763-4655-bdd5-325f6a68303e]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:16:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3" returned: 0 in 0.499s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46c0494d-8e5f-4110-b2e9-d296c558b3be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:16:30 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "cinder-0a176c9e-c03c-431f-9712-4111c6305e3a-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:16:30 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[db823845-4fac-4bc0-87b9-098dbe56e21b]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:16:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:30 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-0a176c9e-c03c-431f-9712-4111c6305e3a-delete_volume" acquired by "delete_volume" :: waited 0.334s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:16:31 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "cinder-quobyte-0a176c9e-c03c-431f-9712-4111c6305e3a" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:16:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-quobyte-0a176c9e-c03c-431f-9712-4111c6305e3a" acquired by "delete_volume" :: waited 0.038s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:16:31 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb0e840-0656-4e71-a802-a2daa5fd6bd1]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:16:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0a176c9e-c03c-431f-9712-4111c6305e3a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be" returned: 0 in 1.262s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3" returned: 0 in 0.508s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0a176c9e-c03c-431f-9712-4111c6305e3a" returned: 0 in 1.237s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0a176c9e-c03c-431f-9712-4111c6305e3a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be.0d925236-93e3-431a-8cd8-2ae085ef6de3" returned: 0 in 0.206s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:33 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Lock "cinder-quobyte-0d925236-93e3-431a-8cd8-2ae085ef6de3" released by "_delete_snapshot" :: held 3.337s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:16:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0a176c9e-c03c-431f-9712-4111c6305e3a" returned: 0 in 0.316s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:33 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Lock "cinder-quobyte-46c0494d-8e5f-4110-b2e9-d296c558b3be" released by "delete_snapshot" :: held 3.392s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:16:33 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-quobyte-0a176c9e-c03c-431f-9712-4111c6305e3a" released by "delete_volume" :: held 1.969s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:16:33 devstack cinder-volume[84134]: WARNING cinder.quota [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1226983469 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1226983469, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:16:33 devstack cinder-volume[84134]: WARNING cinder.quota [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1226983469 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1226983469, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:16:33 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Created reservations ['2bc2fe46-4431-43b2-9852-0e9b49a6925c', '1214146d-43ea-435a-b1bf-ac39712e0fc3', '09d07fa1-9ff5-43c8-911f-d98d2574121b', '4776efc4-ada8-48a3-be2b-d16c372175cc'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:16:33 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] Created reservations ['c9ce2b6b-f48a-49cc-809f-2d983d97b579', '564d3df8-be43-41af-843b-68b98bc6120b', '2fd7794b-6eb7-40eb-a60b-4a9d23f34bc3', 'cd347105-5255-4871-a27f-a4364a00902b'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:16:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "cinder-59f741e8-0716-432e-ac5e-9ef9b5836569-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:16:34 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-c2d3a8f1-7b90-43f6-90a4-4c1bf8f62fa9 tempest-GroupSnapshotsV319Test-814295482 None] group_snapshot 4479a150-0cda-4f18-a228-eb4e89fa863f: deleted successfully
Sep 18 01:16:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.712s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:34 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:16:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-59f741e8-0716-432e-ac5e-9ef9b5836569-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:16:34 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Deleted volume successfully.
Sep 18 01:16:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-15475113-b950-4701-b5c5-6de09623eca4 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-0a176c9e-c03c-431f-9712-4111c6305e3a-delete_volume" released by "delete_volume" :: held 3.937s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:16:34 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "cinder-quobyte-59f741e8-0716-432e-ac5e-9ef9b5836569" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:16:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-quobyte-59f741e8-0716-432e-ac5e-9ef9b5836569" acquired by "delete_volume" :: waited 0.012s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:16:34 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ff408d-2c10-4ba0-9b75-6ec352a45afa]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:16:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-59f741e8-0716-432e-ac5e-9ef9b5836569 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:35 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:35 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Acquiring lock "cinder-quobyte-46c0494d-8e5f-4110-b2e9-d296c558b3be" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:16:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-59f741e8-0716-432e-ac5e-9ef9b5836569" returned: 0 in 0.830s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-59f741e8-0716-432e-ac5e-9ef9b5836569 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-59f741e8-0716-432e-ac5e-9ef9b5836569" returned: 0 in 0.180s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:36 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Lock "cinder-quobyte-46c0494d-8e5f-4110-b2e9-d296c558b3be" acquired by "delete_volume" :: waited 0.287s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:16:36 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7fb03f-4f4c-4426-999f-c2ddabad95ef]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:16:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:36 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-quobyte-59f741e8-0716-432e-ac5e-9ef9b5836569" released by "delete_volume" :: held 1.262s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:16:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be" returned: 0 in 0.671s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:36 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Created reservations ['b502599f-aec1-4815-ba6e-3f01ab4a58a8', 'd0dec8ef-56b3-466e-b854-f8d9e165ab8c', '978d63f9-3387-4f08-bff1-7defe66f013f', 'e9c79875-a724-46db-8698-b89ec76bad94'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:16:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-46c0494d-8e5f-4110-b2e9-d296c558b3be" returned: 0 in 0.266s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:37 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Lock "cinder-quobyte-46c0494d-8e5f-4110-b2e9-d296c558b3be" released by "delete_volume" :: held 1.068s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:16:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.253s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:37 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:16:37 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "cinder-ea2adf3d-be84-4c6f-9257-73e956d7e9e6-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:16:37 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Created reservations ['23c60111-3848-4036-b22f-15057dffaabc'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:16:37 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Deleted volume successfully.
Sep 18 01:16:38 devstack cinder-volume[84134]: WARNING cinder.quota [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1226983469 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1226983469, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f3b91a50-83fa-4e37-9e01-8cb9c09f0263 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-59f741e8-0716-432e-ac5e-9ef9b5836569-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-ea2adf3d-be84-4c6f-9257-73e956d7e9e6-delete_volume" acquired by "delete_volume" :: waited 0.184s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Created reservations ['3a4180c6-172f-4fd2-b9f6-3edb7d3889cf', '7995abfc-83d0-40a2-afae-6d54175ced34', '92c53714-f9e0-4a3b-bd86-7c14dbc762df', '9ccae190-4e57-4846-ac8e-dd740f92435b'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:16:38 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "cinder-quobyte-ea2adf3d-be84-4c6f-9257-73e956d7e9e6" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-quobyte-ea2adf3d-be84-4c6f-9257-73e956d7e9e6" acquired by "delete_volume" :: waited 0.027s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ac8c6a-5ce5-4c24-b02a-d03a1298c616]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ea2adf3d-be84-4c6f-9257-73e956d7e9e6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.154s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:38 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:16:39 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8fa2366f-9041-4664-826c-2fc5edc96738 tempest-GroupSnapshotsV319Test-814295482 None] Delete group completed successfully.
Sep 18 01:16:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ea2adf3d-be84-4c6f-9257-73e956d7e9e6" returned: 0 in 0.862s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ea2adf3d-be84-4c6f-9257-73e956d7e9e6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-ea2adf3d-be84-4c6f-9257-73e956d7e9e6" returned: 0 in 0.241s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:39 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-quobyte-ea2adf3d-be84-4c6f-9257-73e956d7e9e6" released by "delete_volume" :: held 1.264s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:16:39 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Created reservations ['c0bdc0d9-0ef1-42ac-8112-ce505af1e4a2', 'eb610e14-d163-449e-a7b6-a1410a9a7861', 'e2f066e3-ec66-4cb9-8af4-7fa6e4ec536d', '54dc7130-edd9-411b-99f3-c6612e6c7bc3'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:16:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "cinder-f478cb8a-8d87-4c84-a716-fd0b4a821bd2-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:16:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.520s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:40 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:16:40 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Deleted volume successfully.
Sep 18 01:16:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-f478cb8a-8d87-4c84-a716-fd0b4a821bd2-delete_volume" acquired by "delete_volume" :: waited 0.313s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:16:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-16e6f5c5-813a-495b-aa06-8b4fee7d7da5 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-ea2adf3d-be84-4c6f-9257-73e956d7e9e6-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:16:40 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "cinder-quobyte-f478cb8a-8d87-4c84-a716-fd0b4a821bd2" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:16:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-quobyte-f478cb8a-8d87-4c84-a716-fd0b4a821bd2" acquired by "delete_volume" :: waited 0.021s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:16:41 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d0905f-ae10-4430-bfb1-04cbae30d3b4]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:16:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f478cb8a-8d87-4c84-a716-fd0b4a821bd2 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f478cb8a-8d87-4c84-a716-fd0b4a821bd2" returned: 0 in 0.747s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f478cb8a-8d87-4c84-a716-fd0b4a821bd2 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-f478cb8a-8d87-4c84-a716-fd0b4a821bd2" returned: 0 in 0.131s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-quobyte-f478cb8a-8d87-4c84-a716-fd0b4a821bd2" released by "delete_volume" :: held 1.118s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:16:42 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Created reservations ['25b0cab5-bfc6-4153-ab41-686c5e45bf63', 'd3eb7e20-234f-4a47-b969-deb2cde21860', '08a202e2-4376-40d8-a473-b6c20b4c0234', '9645a6f1-adf2-4324-a98b-cfb76c1383a8'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:16:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "cinder-47a1bbd9-7063-4aac-8918-f6d081a9fad1-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:16:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.501s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:43 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:16:43 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Deleted volume successfully.
Sep 18 01:16:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-47a1bbd9-7063-4aac-8918-f6d081a9fad1-delete_volume" acquired by "delete_volume" :: waited 0.298s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:16:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2246f2e8-6534-4bf4-9ca5-b0ca7317ef56 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-f478cb8a-8d87-4c84-a716-fd0b4a821bd2-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:16:43 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "cinder-quobyte-47a1bbd9-7063-4aac-8918-f6d081a9fad1" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:16:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-quobyte-47a1bbd9-7063-4aac-8918-f6d081a9fad1" acquired by "delete_volume" :: waited 0.016s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:16:43 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5378db3b-ca50-44bd-89ab-9b29b214ccac]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:16:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-47a1bbd9-7063-4aac-8918-f6d081a9fad1 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-47a1bbd9-7063-4aac-8918-f6d081a9fad1" returned: 0 in 0.639s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-47a1bbd9-7063-4aac-8918-f6d081a9fad1 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-47a1bbd9-7063-4aac-8918-f6d081a9fad1" returned: 0 in 0.156s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-quobyte-47a1bbd9-7063-4aac-8918-f6d081a9fad1" released by "delete_volume" :: held 1.014s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:16:45 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Created reservations ['f42d27df-cee5-40f7-aae6-1cf3b5e1d610', 'a9ec5a44-e37a-4dab-80fa-525f64759878', '05310253-eadd-405f-90ea-9292a507eeef', '01713924-e48c-45cc-95d2-a77125642a2d'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:16:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.137s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:45 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:16:45 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Deleted volume successfully.
Sep 18 01:16:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b3ce3563-0488-4256-9049-0af93d610f07 tempest-CreateVolumesFromImageTest-433981544 None] Lock "cinder-47a1bbd9-7063-4aac-8918-f6d081a9fad1-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:16:50 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Flow 'volume_create_manager' (c13f5f1b-f97b-45ff-97cf-41af7abe79bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49ff681-792b-472b-a785-3d4fc449f5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49ff681-792b-472b-a785-3d4fc449f5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e4da54-53b3-4555-9559-d08afa19196a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea243b487024b7cadd9d0f9741317e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:50Z,use_quota=True,user_id='6a505f4910b840339c380d2d7c10c177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3263e6a7-d75a-4389-a233-172c671476f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3263e6a7-d75a-4389-a233-172c671476f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26522a1-e556-497f-a4eb-ff99eef13530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26522a1-e556-497f-a4eb-ff99eef13530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e4da54-53b3-4555-9559-d08afa19196a', 'volume_name': 'volume-51e4da54-53b3-4555-9559-d08afa19196a', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a20c70f-e77c-4eba-8477-b0cedadbd45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a20c70f-e77c-4eba-8477-b0cedadbd45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635b2254-9032-422a-bcde-108ee3236da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:50 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Volume 51e4da54-53b3-4555-9559-d08afa19196a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e4da54-53b3-4555-9559-d08afa19196a', 'volume_size': 1}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e4da54-53b3-4555-9559-d08afa19196a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea243b487024b7cadd9d0f9741317e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:50Z,use_quota=True,user_id='6a505f4910b840339c380d2d7c10c177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Creating volume 51e4da54-53b3-4555-9559-d08afa19196a {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:16:50 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:16:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-51e4da54-53b3-4555-9559-d08afa19196a 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:50 devstack quobyte-client[84147]: System call of process 96486 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:16:50 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=93, name=volume-51e4da54-53b3-4555-9559-d08afa19196a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:16:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-51e4da54-53b3-4555-9559-d08afa19196a 1073741824" returned: 0 in 0.476s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-51e4da54-53b3-4555-9559-d08afa19196a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-51e4da54-53b3-4555-9559-d08afa19196a" returned: 0 in 0.221s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] <== create_volume: return (824ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:16:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635b2254-9032-422a-bcde-108ee3236da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e4da54-53b3-4555-9559-d08afa19196a', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b617bca6-4dd5-4869-a18b-38d3767deccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:51 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Volume volume-51e4da54-53b3-4555-9559-d08afa19196a (51e4da54-53b3-4555-9559-d08afa19196a): created successfully
Sep 18 01:16:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b617bca6-4dd5-4869-a18b-38d3767deccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Flow 'volume_create_manager' (c13f5f1b-f97b-45ff-97cf-41af7abe79bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:51 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-cb4aae9b-4b83-4a01-8d0e-a590164f4b52 tempest-CinderUnicodeTest-984027816 None] Created volume successfully.
Sep 18 01:16:53 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Flow 'volume_create_manager' (217304e7-9414-453f-b4da-58fe549d31b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42312155-9544-4222-b47e-346ec8856718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42312155-9544-4222-b47e-346ec8856718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1226790530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93879a95-4a5f-4333-9eca-d6d8fd596c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea243b487024b7cadd9d0f9741317e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:53Z,use_quota=True,user_id='6a505f4910b840339c380d2d7c10c177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f7c959-00e6-4b30-81bf-88f46f22aa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f7c959-00e6-4b30-81bf-88f46f22aa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916bf706-9dbf-4bb3-aa79-ee6583aa9beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916bf706-9dbf-4bb3-aa79-ee6583aa9beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93879a95-4a5f-4333-9eca-d6d8fd596c17', 'volume_name': 'volume-93879a95-4a5f-4333-9eca-d6d8fd596c17', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3274f67c-6cb0-4f25-a8d0-bf140d04312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3274f67c-6cb0-4f25-a8d0-bf140d04312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5b0729-c9ca-4167-aa17-c3958a0ecfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:53 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Volume 93879a95-4a5f-4333-9eca-d6d8fd596c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93879a95-4a5f-4333-9eca-d6d8fd596c17', 'volume_size': 1}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1226790530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93879a95-4a5f-4333-9eca-d6d8fd596c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea243b487024b7cadd9d0f9741317e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:53Z,use_quota=True,user_id='6a505f4910b840339c380d2d7c10c177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Creating volume 93879a95-4a5f-4333-9eca-d6d8fd596c17 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:16:53 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:16:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:53 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=94, name=volume-93879a95-4a5f-4333-9eca-d6d8fd596c17, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:16:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17 1073741824" returned: 0 in 0.414s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17" returned: 0 in 0.138s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] <== create_volume: return (667ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:16:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5b0729-c9ca-4167-aa17-c3958a0ecfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93879a95-4a5f-4333-9eca-d6d8fd596c17', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edbbd1a-5a02-48d5-aa2d-be07a069bd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:54 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Volume volume-93879a95-4a5f-4333-9eca-d6d8fd596c17 (93879a95-4a5f-4333-9eca-d6d8fd596c17): created successfully
Sep 18 01:16:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edbbd1a-5a02-48d5-aa2d-be07a069bd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Flow 'volume_create_manager' (217304e7-9414-453f-b4da-58fe549d31b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:54 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-9d023eac-b4dc-4d6d-8d02-8b1487320262 tempest-CinderUnicodeTest-984027816 None] Created volume successfully.
Sep 18 01:16:55 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-316dbf8c-401a-40ac-9feb-573e50d78ca6 tempest-GroupsTest-65623963 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:55 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-316dbf8c-401a-40ac-9feb-573e50d78ca6 tempest-GroupsTest-65623963 None] Group tempest-Group1-1442977778: creating
Sep 18 01:16:55 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-316dbf8c-401a-40ac-9feb-573e50d78ca6 tempest-GroupsTest-65623963 None] Group tempest-Group1-1442977778: created successfully
Sep 18 01:16:55 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-316dbf8c-401a-40ac-9feb-573e50d78ca6 tempest-GroupsTest-65623963 None] Create group completed successfully.
Sep 18 01:16:56 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] Creating offline snapshot 7a98f41d-e78c-4ffc-a94c-5979db29b213 of volume 93879a95-4a5f-4333-9eca-d6d8fd596c17 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:16:56 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3046fef6-6747-40c2-b7b3-db29491b56c0]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:16:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17" returned: 0 in 0.519s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:56 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=95, name=volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:16:57 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-dac7c3ee-2356-4b9e-b3e9-41fc011dde4e tempest-GroupsTest-65623963 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:57 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-dac7c3ee-2356-4b9e-b3e9-41fc011dde4e tempest-GroupsTest-65623963 None] Group tempest-Group2-1101251060: creating
Sep 18 01:16:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213 1G" returned: 0 in 0.601s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): qemu-img rebase -u -b volume-93879a95-4a5f-4333-9eca-d6d8fd596c17 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:57 devstack quobyte-client[84147]: System call of process 96504 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:16:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:16:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:16:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:16:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:16:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:16:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] CMD "qemu-img rebase -u -b volume-93879a95-4a5f-4333-9eca-d6d8fd596c17 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213" returned: 0 in 0.851s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:16:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:58 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-dac7c3ee-2356-4b9e-b3e9-41fc011dde4e tempest-GroupsTest-65623963 None] Group tempest-Group2-1101251060: created successfully
Sep 18 01:16:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 1.042s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:58 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:16:59 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-dac7c3ee-2356-4b9e-b3e9-41fc011dde4e tempest-GroupsTest-65623963 None] Create group completed successfully.
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213" returned: 0 in 0.801s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:16:59 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Flow 'volume_create_manager' (3847015a-bba0-4d68-a213-f24f97325bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf80f851-26e6-4aea-909f-61827e74d128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf80f851-26e6-4aea-909f-61827e74d128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-944677742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=15937351-8ee0-4337-b42d-b8a8841813cc,host='devstack@QuobyteHD#QuobyteHD',id=91bf2ef3-2df8-451c-93e9-d044cc8c4a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc81fe9fc65644a296e0097c76aafad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:59Z,use_quota=True,user_id='a548c7cd988f45dfb9f8f3f05120fe7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78efb449-df4d-4d72-9d13-3aed31e0e370),volume_type_id=78efb449-df4d-4d72-9d13-3aed31e0e370)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3955cae-0892-49be-942f-59b009873b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3955cae-0892-49be-942f-59b009873b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2fe51e7-5793-418b-87dd-0c9a790923e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2fe51e7-5793-418b-87dd-0c9a790923e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91bf2ef3-2df8-451c-93e9-d044cc8c4a27', 'volume_name': 'volume-91bf2ef3-2df8-451c-93e9-d044cc8c4a27', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3755ccb-8efe-49b9-b35e-5e8c1fca44b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3755ccb-8efe-49b9-b35e-5e8c1fca44b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd75152b-8fe4-48b7-a323-98303fc37371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:16:59 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Volume 91bf2ef3-2df8-451c-93e9-d044cc8c4a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91bf2ef3-2df8-451c-93e9-d044cc8c4a27', 'volume_size': 1}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213" returned: 0 in 0.952s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:16:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.info" returned: 0 in 0.178s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.info" returned: 0 in 0.185s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.388s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.771s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=15937351-8ee0-4337-b42d-b8a8841813cc,created_at=2025-09-17T23:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-944677742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=15937351-8ee0-4337-b42d-b8a8841813cc,host='devstack@QuobyteHD#QuobyteHD',id=91bf2ef3-2df8-451c-93e9-d044cc8c4a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc81fe9fc65644a296e0097c76aafad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:16:59Z,use_quota=True,user_id='a548c7cd988f45dfb9f8f3f05120fe7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78efb449-df4d-4d72-9d13-3aed31e0e370),volume_type_id=78efb449-df4d-4d72-9d13-3aed31e0e370)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Creating volume 91bf2ef3-2df8-451c-93e9-d044cc8c4a27 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:17:00 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:17:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-91bf2ef3-2df8-451c-93e9-d044cc8c4a27 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:00 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=97, name=volume-91bf2ef3-2df8-451c-93e9-d044cc8c4a27, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:17:01 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8f6ea420-cdf7-4d1f-915f-20b8bb2985ca tempest-CinderUnicodeTest-984027816 None] Create snapshot completed successfully
Sep 18 01:17:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-91bf2ef3-2df8-451c-93e9-d044cc8c4a27 1073741824" returned: 0 in 0.485s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-91bf2ef3-2df8-451c-93e9-d044cc8c4a27 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-91bf2ef3-2df8-451c-93e9-d044cc8c4a27" returned: 0 in 0.106s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] <== create_volume: return (709ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:17:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Acquiring lock "cinder-7a98f41d-e78c-4ffc-a94c-5979db29b213-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd75152b-8fe4-48b7-a323-98303fc37371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91bf2ef3-2df8-451c-93e9-d044cc8c4a27', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0d4ea7-a1a7-4589-966d-64c692fec359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:02 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Volume volume-91bf2ef3-2df8-451c-93e9-d044cc8c4a27 (91bf2ef3-2df8-451c-93e9-d044cc8c4a27): created successfully
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0d4ea7-a1a7-4589-966d-64c692fec359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Flow 'volume_create_manager' (3847015a-bba0-4d68-a213-f24f97325bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Lock "cinder-7a98f41d-e78c-4ffc-a94c-5979db29b213-delete_snapshot" acquired by "delete_snapshot" :: waited 0.216s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:02 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Acquiring lock "cinder-quobyte-93879a95-4a5f-4333-9eca-d6d8fd596c17" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Lock "cinder-quobyte-93879a95-4a5f-4333-9eca-d6d8fd596c17" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Acquiring lock "cinder-quobyte-7a98f41d-e78c-4ffc-a94c-5979db29b213" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:02 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-58044bc2-3383-440b-9d08-13ad463070ce tempest-GroupsTest-65623963 None] Created volume successfully.
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Lock "cinder-quobyte-7a98f41d-e78c-4ffc-a94c-5979db29b213" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Deleting offline snapshot 7a98f41d-e78c-4ffc-a94c-5979db29b213 of volume 93879a95-4a5f-4333-9eca-d6d8fd596c17 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] snapshot_file for this snap is: volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5208a718-91fe-4a0f-b1a4-666fb11c305d]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213" returned: 0 in 0.553s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93879a95-4a5f-4333-9eca-d6d8fd596c17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e361ef-0f0a-4527-973d-757605e9a061]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:03 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17" returned: 0 in 0.756s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:03 devstack quobyte-client[84147]: System call of process 96560 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:17:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Acquiring lock "cinder-quobyte-91bf2ef3-2df8-451c-93e9-d044cc8c4a27" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213" returned: 0 in 0.328s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Lock "cinder-quobyte-91bf2ef3-2df8-451c-93e9-d044cc8c4a27" acquired by "delete_volume" :: waited 0.149s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:04 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1a5a65-5027-480e-9023-28994197164e]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-91bf2ef3-2df8-451c-93e9-d044cc8c4a27 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17.7a98f41d-e78c-4ffc-a94c-5979db29b213" returned: 0 in 0.313s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Lock "cinder-quobyte-7a98f41d-e78c-4ffc-a94c-5979db29b213" released by "_delete_snapshot" :: held 2.365s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Lock "cinder-quobyte-93879a95-4a5f-4333-9eca-d6d8fd596c17" released by "delete_snapshot" :: held 2.437s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-91bf2ef3-2df8-451c-93e9-d044cc8c4a27" returned: 0 in 0.749s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-91bf2ef3-2df8-451c-93e9-d044cc8c4a27 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:05 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Created reservations ['042566a0-90d4-414b-9547-7f6b31cd01ff', 'a5847e6f-b323-4095-a560-8996e1ff05a7', '6b7a3547-7992-4a41-8d37-2d19c1f94614', '42a0c835-08f3-4666-b13e-09589037f4b4'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-91bf2ef3-2df8-451c-93e9-d044cc8c4a27" returned: 0 in 0.307s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Lock "cinder-quobyte-91bf2ef3-2df8-451c-93e9-d044cc8c4a27" released by "delete_volume" :: held 1.424s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:05 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Delete snapshot completed successfully.
Sep 18 01:17:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7bfe2b2a-d753-4769-81a2-575cb3652e79 tempest-CinderUnicodeTest-984027816 None] Lock "cinder-7a98f41d-e78c-4ffc-a94c-5979db29b213-delete_snapshot" released by "delete_snapshot" :: held 3.421s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:05 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Created reservations ['98116933-b1a3-45b1-97cb-ad31f675f1fe'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:05 devstack cinder-volume[84134]: WARNING cinder.quota [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-274821399 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-274821399, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:17:05 devstack cinder-volume[84134]: WARNING cinder.quota [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-274821399 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-274821399, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:17:05 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Created reservations ['2d3655ed-2058-4129-8b3b-3f9d7cce00b2', '7cd20e28-9b0e-460c-905e-2b32b1988f78', '32adc281-746e-4dde-95db-f32f67ccfef9', '23680a97-cb2a-4a56-b2ab-8babd47c31bd'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:17:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:17:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.137s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:05 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:17:06 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-f43e473b-2266-4fec-80ca-4dbfe938fca6 tempest-GroupsTest-65623963 None] Delete group completed successfully.
Sep 18 01:17:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Acquiring lock "cinder-93879a95-4a5f-4333-9eca-d6d8fd596c17-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Lock "cinder-93879a95-4a5f-4333-9eca-d6d8fd596c17-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:06 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Acquiring lock "cinder-quobyte-93879a95-4a5f-4333-9eca-d6d8fd596c17" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Lock "cinder-quobyte-93879a95-4a5f-4333-9eca-d6d8fd596c17" acquired by "delete_volume" :: waited 0.017s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:06 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b9f742-9faa-4199-8529-7082cd13d985]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:07 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-ba937192-150c-4353-bbf2-028ac71b5ddb tempest-GroupsTest-65623963 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17" returned: 0 in 0.702s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:07 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-ba937192-150c-4353-bbf2-028ac71b5ddb tempest-GroupsTest-65623963 None] Created reservations ['650471d6-7d39-4cb7-ad24-92ceb9d6f840'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-93879a95-4a5f-4333-9eca-d6d8fd596c17" returned: 0 in 0.380s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Lock "cinder-quobyte-93879a95-4a5f-4333-9eca-d6d8fd596c17" released by "delete_volume" :: held 1.206s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ba937192-150c-4353-bbf2-028ac71b5ddb tempest-GroupsTest-65623963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ba937192-150c-4353-bbf2-028ac71b5ddb tempest-GroupsTest-65623963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ba937192-150c-4353-bbf2-028ac71b5ddb tempest-GroupsTest-65623963 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:17:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ba937192-150c-4353-bbf2-028ac71b5ddb tempest-GroupsTest-65623963 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:17:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ba937192-150c-4353-bbf2-028ac71b5ddb tempest-GroupsTest-65623963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ba937192-150c-4353-bbf2-028ac71b5ddb tempest-GroupsTest-65623963 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ba937192-150c-4353-bbf2-028ac71b5ddb tempest-GroupsTest-65623963 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.222s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:08 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-ba937192-150c-4353-bbf2-028ac71b5ddb tempest-GroupsTest-65623963 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:17:08 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-ba937192-150c-4353-bbf2-028ac71b5ddb tempest-GroupsTest-65623963 None] Delete group completed successfully.
Sep 18 01:17:08 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Created reservations ['3d174b47-8151-4b05-a3c2-761ec93044b1', 'd00d77da-8841-4431-8a65-4ad6aef46ac4', '9b460ab9-704b-470f-b19b-ae89d4e8c905', '1f1adb4c-9445-449a-92a5-030db947c3e4'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:08 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:17:08 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:17:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.115s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:08 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:17:08 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Deleted volume successfully.
Sep 18 01:17:08 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=76,cinder:UPDATE=108,cinder:DELETE=9,cinder:INSERT=23 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:17:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-454949ad-02de-481d-9018-89e259b82cd9 tempest-CinderUnicodeTest-984027816 None] Lock "cinder-93879a95-4a5f-4333-9eca-d6d8fd596c17-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Acquiring lock "cinder-51e4da54-53b3-4555-9559-d08afa19196a-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Lock "cinder-51e4da54-53b3-4555-9559-d08afa19196a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:09 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=94,cinder:UPDATE=107,cinder:DELETE=7,cinder:INSERT=20 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:17:09 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-39e3ac44-a147-4b6d-ad0c-b3ab303d82b3 tempest-GroupsTest-65623963 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:09 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-39e3ac44-a147-4b6d-ad0c-b3ab303d82b3 tempest-GroupsTest-65623963 None] Group tempest-GroupsTest-Group-995713793: creating
Sep 18 01:17:09 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Acquiring lock "cinder-quobyte-51e4da54-53b3-4555-9559-d08afa19196a" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Lock "cinder-quobyte-51e4da54-53b3-4555-9559-d08afa19196a" acquired by "delete_volume" :: waited 0.022s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:09 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-39e3ac44-a147-4b6d-ad0c-b3ab303d82b3 tempest-GroupsTest-65623963 None] Group tempest-GroupsTest-Group-995713793: created successfully
Sep 18 01:17:09 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a4a596-fd51-4d71-b58b-5e637791416a]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-51e4da54-53b3-4555-9559-d08afa19196a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:10 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-39e3ac44-a147-4b6d-ad0c-b3ab303d82b3 tempest-GroupsTest-65623963 None] Create group completed successfully.
Sep 18 01:17:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-51e4da54-53b3-4555-9559-d08afa19196a" returned: 0 in 0.502s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-51e4da54-53b3-4555-9559-d08afa19196a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-51e4da54-53b3-4555-9559-d08afa19196a" returned: 0 in 0.124s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Lock "cinder-quobyte-51e4da54-53b3-4555-9559-d08afa19196a" released by "delete_volume" :: held 0.794s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:10 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Created reservations ['9e481e43-0505-4eca-821e-58fce12827d2', '7aae5527-e1e2-483e-b863-295de87c0b56', '7bdf1939-af90-488b-b1df-bd6052d32da2', '717238c9-8c49-4748-bf9f-f99f63782a58'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:17:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:17:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.218s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:11 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:17:11 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Deleted volume successfully.
Sep 18 01:17:11 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:11 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:17:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Flow 'volume_create_manager' (a253f1e6-cc56-48ed-879c-f94ff287990a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:17:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7150848c-5375-4b51-a393-7944117caef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d4d1bc38-32aa-441d-999f-21a4d6732858 tempest-CinderUnicodeTest-984027816 None] Lock "cinder-51e4da54-53b3-4555-9559-d08afa19196a-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7150848c-5375-4b51-a393-7944117caef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-137415717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9c074902-9788-4aa6-b901-bcf664622448,host='devstack@QuobyteHD#QuobyteHD',id=de5a867b-af95-42de-94bf-0a2a39c4211f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc81fe9fc65644a296e0097c76aafad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:17:11Z,use_quota=True,user_id='a548c7cd988f45dfb9f8f3f05120fe7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c2b9707-17bd-4885-8135-73d025eb3451),volume_type_id=3c2b9707-17bd-4885-8135-73d025eb3451)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea975d3-9e69-4a59-8df6-386ea5c9ad01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea975d3-9e69-4a59-8df6-386ea5c9ad01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe60fae8-e633-4588-b712-0a31ed82dcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe60fae8-e633-4588-b712-0a31ed82dcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de5a867b-af95-42de-94bf-0a2a39c4211f', 'volume_name': 'volume-de5a867b-af95-42de-94bf-0a2a39c4211f', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7b26c3-c91d-4b72-8359-069e7d926915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7b26c3-c91d-4b72-8359-069e7d926915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5187194-dd2b-4299-a188-04d9719cc03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:12 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Volume de5a867b-af95-42de-94bf-0a2a39c4211f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de5a867b-af95-42de-94bf-0a2a39c4211f', 'volume_size': 1}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9c074902-9788-4aa6-b901-bcf664622448,created_at=2025-09-17T23:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-137415717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9c074902-9788-4aa6-b901-bcf664622448,host='devstack@QuobyteHD#QuobyteHD',id=de5a867b-af95-42de-94bf-0a2a39c4211f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc81fe9fc65644a296e0097c76aafad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:17:11Z,use_quota=True,user_id='a548c7cd988f45dfb9f8f3f05120fe7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c2b9707-17bd-4885-8135-73d025eb3451),volume_type_id=3c2b9707-17bd-4885-8135-73d025eb3451)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Creating volume de5a867b-af95-42de-94bf-0a2a39c4211f {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:17:12 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-de5a867b-af95-42de-94bf-0a2a39c4211f 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:12 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=98, name=volume-de5a867b-af95-42de-94bf-0a2a39c4211f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:17:12 devstack quobyte-client[84147]: System call of process 96583 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-de5a867b-af95-42de-94bf-0a2a39c4211f 1073741824" returned: 0 in 0.330s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-de5a867b-af95-42de-94bf-0a2a39c4211f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-de5a867b-af95-42de-94bf-0a2a39c4211f" returned: 0 in 0.127s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] <== create_volume: return (533ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:17:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.547s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5187194-dd2b-4299-a188-04d9719cc03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de5a867b-af95-42de-94bf-0a2a39c4211f', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef435b4-c3a2-4f70-9c89-9f73d126ca68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:13 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Volume volume-de5a867b-af95-42de-94bf-0a2a39c4211f (de5a867b-af95-42de-94bf-0a2a39c4211f): created successfully
Sep 18 01:17:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef435b4-c3a2-4f70-9c89-9f73d126ca68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Flow 'volume_create_manager' (a253f1e6-cc56-48ed-879c-f94ff287990a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:17:13 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-22a328de-7e3b-4a8c-ab25-5f84abfd7a5c tempest-GroupsTest-65623963 None] Created volume successfully.
Sep 18 01:17:14 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Flow 'volume_create_manager' (148189ad-2b74-4990-b632-2e070cbba3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2004c285-5be5-4218-b77c-b51e34ae9ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2004c285-5be5-4218-b77c-b51e34ae9ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1395420058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9c074902-9788-4aa6-b901-bcf664622448,host='devstack@QuobyteHD#QuobyteHD',id=874be428-2c19-44f7-b3dc-80e0c8444485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc81fe9fc65644a296e0097c76aafad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:17:15Z,use_quota=True,user_id='a548c7cd988f45dfb9f8f3f05120fe7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c2b9707-17bd-4885-8135-73d025eb3451),volume_type_id=3c2b9707-17bd-4885-8135-73d025eb3451)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad70e20e-208a-4078-afb8-e9b971d0f07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad70e20e-208a-4078-afb8-e9b971d0f07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7f3cfe-7719-47ee-9aa0-63a387bc83f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7f3cfe-7719-47ee-9aa0-63a387bc83f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874be428-2c19-44f7-b3dc-80e0c8444485', 'volume_name': 'volume-874be428-2c19-44f7-b3dc-80e0c8444485', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e3d369-b045-4dba-abc3-eea300100be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e3d369-b045-4dba-abc3-eea300100be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03be104-7472-4c9a-9931-29963041f24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:14 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Volume 874be428-2c19-44f7-b3dc-80e0c8444485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874be428-2c19-44f7-b3dc-80e0c8444485', 'volume_size': 1}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9c074902-9788-4aa6-b901-bcf664622448,created_at=2025-09-17T23:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1395420058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9c074902-9788-4aa6-b901-bcf664622448,host='devstack@QuobyteHD#QuobyteHD',id=874be428-2c19-44f7-b3dc-80e0c8444485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc81fe9fc65644a296e0097c76aafad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:17:15Z,use_quota=True,user_id='a548c7cd988f45dfb9f8f3f05120fe7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c2b9707-17bd-4885-8135-73d025eb3451),volume_type_id=3c2b9707-17bd-4885-8135-73d025eb3451)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Creating volume 874be428-2c19-44f7-b3dc-80e0c8444485 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:17:14 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:17:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-874be428-2c19-44f7-b3dc-80e0c8444485 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:15 devstack quobyte-client[84147]: System call of process 96621 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:17:15 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=99, name=volume-874be428-2c19-44f7-b3dc-80e0c8444485, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:17:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-874be428-2c19-44f7-b3dc-80e0c8444485 1073741824" returned: 0 in 0.329s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-874be428-2c19-44f7-b3dc-80e0c8444485 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-874be428-2c19-44f7-b3dc-80e0c8444485" returned: 0 in 0.087s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] <== create_volume: return (480ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:17:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.493s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03be104-7472-4c9a-9931-29963041f24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874be428-2c19-44f7-b3dc-80e0c8444485', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4820772-cb1a-4499-a0fa-b4159f1c72ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:15 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Volume volume-874be428-2c19-44f7-b3dc-80e0c8444485 (874be428-2c19-44f7-b3dc-80e0c8444485): created successfully
Sep 18 01:17:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4820772-cb1a-4499-a0fa-b4159f1c72ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Flow 'volume_create_manager' (148189ad-2b74-4990-b632-2e070cbba3a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:17:15 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-7d5cc9ef-4585-4809-a811-24ad031ad571 tempest-GroupsTest-65623963 None] Created volume successfully.
Sep 18 01:17:15 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e65ec3cd-8855-4425-9988-c4594aa28417 tempest-GroupsTest-65623963 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:16 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e65ec3cd-8855-4425-9988-c4594aa28417 tempest-GroupsTest-65623963 None] Update group completed successfully.
Sep 18 01:17:17 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-1b3633b4-d0f0-4fa0-bcac-fdf65283dc9b tempest-GroupsTest-65623963 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:17 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-1b3633b4-d0f0-4fa0-bcac-fdf65283dc9b tempest-GroupsTest-65623963 None] Update group completed successfully.
Sep 18 01:17:18 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:18 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Acquiring lock "cinder-quobyte-874be428-2c19-44f7-b3dc-80e0c8444485" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:18 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Lock "cinder-quobyte-874be428-2c19-44f7-b3dc-80e0c8444485" acquired by "delete_volume" :: waited 0.067s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:18 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5b1b14-3924-4dd4-8dda-359e425bf0b9]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-874be428-2c19-44f7-b3dc-80e0c8444485 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-874be428-2c19-44f7-b3dc-80e0c8444485" returned: 0 in 0.430s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-874be428-2c19-44f7-b3dc-80e0c8444485 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-874be428-2c19-44f7-b3dc-80e0c8444485" returned: 0 in 0.114s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Lock "cinder-quobyte-874be428-2c19-44f7-b3dc-80e0c8444485" released by "delete_volume" :: held 0.699s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Acquiring lock "cinder-quobyte-de5a867b-af95-42de-94bf-0a2a39c4211f" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Lock "cinder-quobyte-de5a867b-af95-42de-94bf-0a2a39c4211f" acquired by "delete_volume" :: waited 0.026s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:19 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95bb0e4-4826-46a8-a4d8-d2be0f938a9c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-de5a867b-af95-42de-94bf-0a2a39c4211f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-de5a867b-af95-42de-94bf-0a2a39c4211f" returned: 0 in 0.458s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-de5a867b-af95-42de-94bf-0a2a39c4211f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-de5a867b-af95-42de-94bf-0a2a39c4211f" returned: 0 in 0.151s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Lock "cinder-quobyte-de5a867b-af95-42de-94bf-0a2a39c4211f" released by "delete_volume" :: held 0.766s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:20 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Created reservations ['ff5cea9b-c3aa-4eb1-892c-5cbdf890adf7'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:20 devstack cinder-volume[84134]: WARNING cinder.quota [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-971616492 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-971616492, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:17:20 devstack cinder-volume[84134]: WARNING cinder.quota [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-971616492 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-971616492, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:17:20 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Created reservations ['809433c1-9ce4-49e2-b1f5-bf475d524e52', '6dffce6b-3893-4bd9-8779-4a33abf17fa6', '43d1bb4c-8f45-4b4d-b08f-5937de4eb8b4', '8a499530-31d5-4396-a273-f6d33e98624e'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:20 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Created reservations ['5666b388-4998-450a-ae13-d9ee438299dc', '1a40939e-c4d3-49d2-9337-a2b81fc8ee33', 'bc0de1b3-187c-4a09-9960-e929ecce1a4d', '729922a2-7c5b-4134-87be-69d48ab41a13'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:17:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:17:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.103s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:21 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:17:21 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-7b24905f-6291-4936-8d92-fa36a503622b tempest-GroupsTest-65623963 None] Delete group completed successfully.
Sep 18 01:17:27 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:27 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:17:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Flow 'volume_create_manager' (45475fda-aa84-4d47-b93f-f5b5cb213110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:17:27 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e746e7-e516-4762-95ed-02189e1d1584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e746e7-e516-4762-95ed-02189e1d1584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-989162943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c54ebb-b28b-4662-9875-2cc44aea00f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b23f2adedab4a8aa09f0e01baa52987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:17:27Z,use_quota=True,user_id='10250ccf764b417b84aa8644ec6a7562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c145101-1270-48ad-a63d-e156589877ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c145101-1270-48ad-a63d-e156589877ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aeb4803-6e22-4051-81c9-c66779e8f29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aeb4803-6e22-4051-81c9-c66779e8f29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c54ebb-b28b-4662-9875-2cc44aea00f6', 'volume_name': 'volume-68c54ebb-b28b-4662-9875-2cc44aea00f6', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668e47cc-4239-466b-b679-f4c740aae50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668e47cc-4239-466b-b679-f4c740aae50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdba5447-a0e9-4de0-b84a-2e2cd49ac1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:28 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Volume 68c54ebb-b28b-4662-9875-2cc44aea00f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c54ebb-b28b-4662-9875-2cc44aea00f6', 'volume_size': 1}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-989162943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c54ebb-b28b-4662-9875-2cc44aea00f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b23f2adedab4a8aa09f0e01baa52987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:17:27Z,use_quota=True,user_id='10250ccf764b417b84aa8644ec6a7562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Creating volume 68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:17:28 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:28 devstack quobyte-client[84147]: System call of process 96657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:17:28 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=100, name=volume-68c54ebb-b28b-4662-9875-2cc44aea00f6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6 1073741824" returned: 0 in 0.341s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6" returned: 0 in 0.115s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] <== create_volume: return (528ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.542s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdba5447-a0e9-4de0-b84a-2e2cd49ac1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c54ebb-b28b-4662-9875-2cc44aea00f6', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a51b6d-d51a-42ef-90a5-9a4246d848a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:28 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Volume volume-68c54ebb-b28b-4662-9875-2cc44aea00f6 (68c54ebb-b28b-4662-9875-2cc44aea00f6): created successfully
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a51b6d-d51a-42ef-90a5-9a4246d848a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Flow 'volume_create_manager' (45475fda-aa84-4d47-b93f-f5b5cb213110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:17:28 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-a8244ea1-8b06-49dc-92f6-ac7570bd8ac4 tempest-SnapshotsActionsTest-1213026262 None] Created volume successfully.
Sep 18 01:17:29 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] Creating offline snapshot 02f6876d-d101-4b1f-9cd4-ef54debd61df of volume 68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:17:30 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5242399-2c17-4107-8337-d82cca71ff36]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6" returned: 0 in 0.443s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:30 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=101, name=volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:17:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df 1G" returned: 0 in 0.232s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68c54ebb-b28b-4662-9875-2cc44aea00f6 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:30 devstack quobyte-client[84147]: System call of process 96667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:17:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] CMD "qemu-img rebase -u -b volume-68c54ebb-b28b-4662-9875-2cc44aea00f6 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df" returned: 0 in 0.165s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:17:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df" returned: 0 in 0.091s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:17:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df" returned: 0 in 0.114s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.info" returned: 0 in 0.098s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:17:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.info" returned: 0 in 0.104s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.575s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:31 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-95d5329c-838c-4a73-a754-d07e502c09f2 tempest-SnapshotsActionsTest-1213026262 None] Create snapshot completed successfully
Sep 18 01:17:32 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:32 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] Creating offline snapshot 3a97f695-f49f-4397-9b34-76946dd90d18 of volume 68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:17:32 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1321f1-a1fc-40ac-a29b-1e1706765fb8]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df" returned: 0 in 0.432s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c54ebb-b28b-4662-9875-2cc44aea00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:17:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:33 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=103, name=volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:17:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18 1G" returned: 0 in 0.262s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] CMD "qemu-img rebase -u -b volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18" returned: 0 in 0.158s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:17:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18" returned: 0 in 0.093s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:17:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18" returned: 0 in 0.088s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.344s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:34 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8fa2850f-b471-4fae-9715-389be0a891fb tempest-SnapshotsActionsTest-1213026262 None] Create snapshot completed successfully
Sep 18 01:17:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Acquiring lock "cinder-3a97f695-f49f-4397-9b34-76946dd90d18-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-3a97f695-f49f-4397-9b34-76946dd90d18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:34 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Acquiring lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Acquiring lock "cinder-quobyte-3a97f695-f49f-4397-9b34-76946dd90d18" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:34 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-3a97f695-f49f-4397-9b34-76946dd90d18" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Deleting offline snapshot 3a97f695-f49f-4397-9b34-76946dd90d18 of volume 68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:17:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] snapshot_file for this snap is: volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:17:34 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f39855b-20ff-4628-bf66-d6f5ca88aaf4]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18" returned: 0 in 0.573s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c54ebb-b28b-4662-9875-2cc44aea00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:17:35 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb27260f-c7e3-4f19-acfc-1415976adcc0]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df" returned: 0 in 0.525s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:36 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c54ebb-b28b-4662-9875-2cc44aea00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:17:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:36 devstack quobyte-client[84147]: System call of process 96694 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:17:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18" returned: 0 in 0.652s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:37 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Flow 'volume_create_manager' (f887585b-2b4d-453f-8ed1-b7ae81676383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575301d1-6bbf-4848-88c3-653c91e135e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.3a97f695-f49f-4397-9b34-76946dd90d18" returned: 0 in 0.527s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575301d1-6bbf-4848-88c3-653c91e135e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1024439905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df114336-bae9-437f-86a5-159643fba836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd48f3f14d4d4432b394369a349df234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:17:36Z,use_quota=True,user_id='a7c4310fa1274979baf8d19731ecb666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b24252-fa1e-4607-884e-66a78706cf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b24252-fa1e-4607-884e-66a78706cf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf10d193-12ed-4adb-b361-8f37716bd885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf10d193-12ed-4adb-b361-8f37716bd885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df114336-bae9-437f-86a5-159643fba836', 'volume_name': 'volume-df114336-bae9-437f-86a5-159643fba836', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbaeb27-3a47-4007-93d7-137240934138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbaeb27-3a47-4007-93d7-137240934138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca4cfa7-5a68-4e1d-9c64-75581e6f9d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:37 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Volume df114336-bae9-437f-86a5-159643fba836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df114336-bae9-437f-86a5-159643fba836', 'volume_size': 1}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1024439905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df114336-bae9-437f-86a5-159643fba836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd48f3f14d4d4432b394369a349df234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:17:36Z,use_quota=True,user_id='a7c4310fa1274979baf8d19731ecb666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Creating volume df114336-bae9-437f-86a5-159643fba836 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:17:37 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-df114336-bae9-437f-86a5-159643fba836 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:37 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=104, name=volume-df114336-bae9-437f-86a5-159643fba836, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-3a97f695-f49f-4397-9b34-76946dd90d18" released by "_delete_snapshot" :: held 2.753s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:37 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" released by "delete_snapshot" :: held 2.930s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-df114336-bae9-437f-86a5-159643fba836 1073741824" returned: 0 in 0.544s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-df114336-bae9-437f-86a5-159643fba836 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-df114336-bae9-437f-86a5-159643fba836" returned: 0 in 0.316s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] <== create_volume: return (911ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:17:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca4cfa7-5a68-4e1d-9c64-75581e6f9d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df114336-bae9-437f-86a5-159643fba836', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6bb083-2c09-4447-af4b-ed2cab21cda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:17:38 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Volume volume-df114336-bae9-437f-86a5-159643fba836 (df114336-bae9-437f-86a5-159643fba836): created successfully
Sep 18 01:17:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6bb083-2c09-4447-af4b-ed2cab21cda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:17:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Flow 'volume_create_manager' (f887585b-2b4d-453f-8ed1-b7ae81676383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:17:38 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-646aac00-38ba-4dd9-923c-edb35ee63d07 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Created volume successfully.
Sep 18 01:17:38 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Created reservations ['f60d84d6-c33e-4c83-85da-1496395bd18c', 'f21d8eea-e69d-464d-9035-73e890cd8135', '8fec55b5-1c0d-47d9-891d-63c604432ea6', 'a5615c33-da43-4506-9aac-f39e8220941e'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:38 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Delete snapshot completed successfully.
Sep 18 01:17:38 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-608c3c3f-03e8-44f3-a0dd-fb74ce899429 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-3a97f695-f49f-4397-9b34-76946dd90d18-delete_snapshot" released by "delete_snapshot" :: held 3.947s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:39 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] Creating offline snapshot 4aee933b-f308-4a64-9bde-1a77674b3f37 of volume 68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:17:39 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[458e6dc5-2b02-4bf8-ba50-37ab5f7ef559]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df" returned: 0 in 0.523s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c54ebb-b28b-4662-9875-2cc44aea00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:17:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:40 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=105, name=volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:17:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37 1G" returned: 0 in 0.266s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] CMD "qemu-img rebase -u -b volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37" returned: 0 in 0.163s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:17:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37" returned: 0 in 0.095s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:17:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37" returned: 0 in 0.093s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.490s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:41 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-f9090035-4b03-4daa-bc7e-364d89cecdd7 tempest-SnapshotsActionsTest-1213026262 None] Create snapshot completed successfully
Sep 18 01:17:41 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Acquiring lock "cinder-4aee933b-f308-4a64-9bde-1a77674b3f37-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:41 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-4aee933b-f308-4a64-9bde-1a77674b3f37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:41 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:41 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Acquiring lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:41 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:41 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Acquiring lock "cinder-quobyte-4aee933b-f308-4a64-9bde-1a77674b3f37" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:41 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-4aee933b-f308-4a64-9bde-1a77674b3f37" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Deleting offline snapshot 4aee933b-f308-4a64-9bde-1a77674b3f37 of volume 68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:17:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] snapshot_file for this snap is: volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:17:41 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97ffaf1-6164-4dad-8937-051cfc926554]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37" returned: 0 in 0.420s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c54ebb-b28b-4662-9875-2cc44aea00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:17:42 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d48d4d8-bcdb-43e1-9331-72e178faec78]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df" returned: 0 in 0.382s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c54ebb-b28b-4662-9875-2cc44aea00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:17:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37" returned: 0 in 0.260s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.4aee933b-f308-4a64-9bde-1a77674b3f37" returned: 0 in 0.112s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-4aee933b-f308-4a64-9bde-1a77674b3f37" released by "_delete_snapshot" :: held 1.526s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" released by "delete_snapshot" :: held 1.552s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:43 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Created reservations ['70cbd7da-f826-4bba-a1e1-3467b742a003', '99f2812b-ca25-41ed-bba1-34d923ca3e64', 'bff8fdbc-f0cf-4f46-88c2-759fab491023', '70ab3a20-2837-4116-8bae-627687dae6ed'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:44 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Delete snapshot completed successfully.
Sep 18 01:17:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-817d2188-5c94-427d-bece-0cd5fbd525c1 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-4aee933b-f308-4a64-9bde-1a77674b3f37-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-b18c8965-0189-4a29-8176-e775d0796f8a req-31c20e3c-54f5-4224-ae93-cfe2fe4ebe34 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-b18c8965-0189-4a29-8176-e775d0796f8a req-31c20e3c-54f5-4224-ae93-cfe2fe4ebe34 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:44 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5516f1e3-f3a7-451e-9280-d16f030f752c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-b18c8965-0189-4a29-8176-e775d0796f8a req-31c20e3c-54f5-4224-ae93-cfe2fe4ebe34 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-df114336-bae9-437f-86a5-159643fba836 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-b18c8965-0189-4a29-8176-e775d0796f8a req-31c20e3c-54f5-4224-ae93-cfe2fe4ebe34 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-df114336-bae9-437f-86a5-159643fba836" returned: 0 in 0.437s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-b18c8965-0189-4a29-8176-e775d0796f8a req-31c20e3c-54f5-4224-ae93-cfe2fe4ebe34 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.488s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:44 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-b18c8965-0189-4a29-8176-e775d0796f8a req-31c20e3c-54f5-4224-ae93-cfe2fe4ebe34 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-df114336-bae9-437f-86a5-159643fba836', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7b67b08-08e6-43dc-845d-cb5f6d866059', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:17:44 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-b18c8965-0189-4a29-8176-e775d0796f8a req-31c20e3c-54f5-4224-ae93-cfe2fe4ebe34 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:45 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-b18c8965-0189-4a29-8176-e775d0796f8a req-31c20e3c-54f5-4224-ae93-cfe2fe4ebe34 tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] attachment_update completed successfully.
Sep 18 01:17:45 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] Creating offline snapshot f4bd7e38-7836-493d-bd79-7ba1ff77a63b of volume 68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:17:45 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[121f859a-5059-473c-a7c7-b4d24a4352ae]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df" returned: 0 in 0.473s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:45 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c54ebb-b28b-4662-9875-2cc44aea00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:17:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:46 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=106, name=volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:17:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b 1G" returned: 0 in 0.333s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] CMD "qemu-img rebase -u -b volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b" returned: 0 in 0.142s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:17:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b" returned: 0 in 0.085s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:17:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b" returned: 0 in 0.130s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.529s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:47 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-375c06b1-83e7-4c67-8383-81b4b41b81a0 tempest-SnapshotsActionsTest-1213026262 None] Create snapshot completed successfully
Sep 18 01:17:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Acquiring lock "cinder-f4bd7e38-7836-493d-bd79-7ba1ff77a63b-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-f4bd7e38-7836-493d-bd79-7ba1ff77a63b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:47 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Acquiring lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Acquiring lock "cinder-quobyte-f4bd7e38-7836-493d-bd79-7ba1ff77a63b" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-f4bd7e38-7836-493d-bd79-7ba1ff77a63b" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Deleting offline snapshot f4bd7e38-7836-493d-bd79-7ba1ff77a63b of volume 68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:17:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] snapshot_file for this snap is: volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:17:47 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[818de89e-6ef3-4faf-b567-3a001531d9d0]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b" returned: 0 in 0.448s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c54ebb-b28b-4662-9875-2cc44aea00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:17:48 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c99dd9a-3c47-4c31-ad9d-9372d340e19d]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df" returned: 0 in 0.378s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c54ebb-b28b-4662-9875-2cc44aea00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:17:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b" returned: 0 in 0.223s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.f4bd7e38-7836-493d-bd79-7ba1ff77a63b" returned: 0 in 0.097s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:49 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-f4bd7e38-7836-493d-bd79-7ba1ff77a63b" released by "_delete_snapshot" :: held 1.437s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:49 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" released by "delete_snapshot" :: held 1.491s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:49 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Created reservations ['a6fd6833-eb5d-4703-8455-a6d205d004ea', '154ae1b1-70af-4ebc-9876-c26420a2650f', 'f791b0eb-f81e-4186-85ac-7a29d3acaf17', 'fff2191b-a881-4e79-8db1-e58051fb4236'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:49 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Delete snapshot completed successfully.
Sep 18 01:17:49 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3f1f5852-e844-4f6a-a153-18008334baf3 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-f4bd7e38-7836-493d-bd79-7ba1ff77a63b-delete_snapshot" released by "delete_snapshot" :: held 1.970s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:50 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] Creating offline snapshot ad886149-d45c-493e-a89a-a26b7dee9a66 of volume 68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:17:50 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[772103a9-1384-404d-bd86-20f8a416a08f]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df" returned: 0 in 0.395s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c54ebb-b28b-4662-9875-2cc44aea00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:17:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:50 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=107, name=volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:17:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66 1G" returned: 0 in 0.249s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] CMD "qemu-img rebase -u -b volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66" returned: 0 in 0.126s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:17:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66" returned: 0 in 0.094s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:17:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66" returned: 0 in 0.163s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.315s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:51 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-9133efd1-c947-4061-8b8e-69aee547894c tempest-SnapshotsActionsTest-1213026262 None] Create snapshot completed successfully
Sep 18 01:17:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Acquiring lock "cinder-ad886149-d45c-493e-a89a-a26b7dee9a66-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-ad886149-d45c-493e-a89a-a26b7dee9a66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:52 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Acquiring lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Acquiring lock "cinder-quobyte-ad886149-d45c-493e-a89a-a26b7dee9a66" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-ad886149-d45c-493e-a89a-a26b7dee9a66" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Deleting offline snapshot ad886149-d45c-493e-a89a-a26b7dee9a66 of volume 68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:17:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] snapshot_file for this snap is: volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:17:52 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa65cc82-0f1e-4210-8c21-78a361c7c41c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66" returned: 0 in 0.452s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c54ebb-b28b-4662-9875-2cc44aea00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:17:53 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5cca79-55cd-4efc-8c29-730de29624a1]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df" returned: 0 in 0.363s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c54ebb-b28b-4662-9875-2cc44aea00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:17:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66" returned: 0 in 0.204s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.ad886149-d45c-493e-a89a-a26b7dee9a66" returned: 0 in 0.109s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-ad886149-d45c-493e-a89a-a26b7dee9a66" released by "_delete_snapshot" :: held 1.460s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" released by "delete_snapshot" :: held 1.494s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:54 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Created reservations ['d9b52b39-8674-4047-80cb-d86941ff4daa', '55bf98a6-f5e2-4762-94b9-d72e54db4203', 'a11cf6d1-892e-42ba-bfa0-240521c92fde', '45ebfecc-7b5c-4c12-91a5-6ffd629cfc7b'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:54 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Delete snapshot completed successfully.
Sep 18 01:17:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b0d93698-f2a6-420a-9027-dbeb2fab3187 tempest-SnapshotsActionsTest-1380685414 None] Lock "cinder-ad886149-d45c-493e-a89a-a26b7dee9a66-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Acquiring lock "cinder-02f6876d-d101-4b1f-9cd4-ef54debd61df-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Lock "cinder-02f6876d-d101-4b1f-9cd4-ef54debd61df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:55 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Acquiring lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Acquiring lock "cinder-quobyte-02f6876d-d101-4b1f-9cd4-ef54debd61df" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Lock "cinder-quobyte-02f6876d-d101-4b1f-9cd4-ef54debd61df" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Deleting offline snapshot 02f6876d-d101-4b1f-9cd4-ef54debd61df of volume 68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] snapshot_file for this snap is: volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6570d586-84f3-4485-aa26-805f90f9618d]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df" returned: 0 in 0.393s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c54ebb-b28b-4662-9875-2cc44aea00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[349f3b0f-6cc6-4ebf-9d50-7ff47692076c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6" returned: 0 in 0.385s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df" returned: 0 in 0.175s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6.02f6876d-d101-4b1f-9cd4-ef54debd61df" returned: 0 in 0.101s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Lock "cinder-quobyte-02f6876d-d101-4b1f-9cd4-ef54debd61df" released by "_delete_snapshot" :: held 1.328s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" released by "delete_snapshot" :: held 1.352s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:56 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Created reservations ['1d611948-f8d9-430b-a5cd-49a862fa130a', 'b6960a6f-f45e-421a-8d76-b184e1abcb82', 'd8e3e346-f6df-4ec3-99c6-07dd75da5a82', '176a5569-1d43-494f-9a79-cd8b63e3c49a'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:56 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Delete snapshot completed successfully.
Sep 18 01:17:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e6e78d81-d139-4afd-9e1d-8f8e4f20c9dc tempest-SnapshotsActionsTest-1213026262 None] Lock "cinder-02f6876d-d101-4b1f-9cd4-ef54debd61df-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Acquiring lock "cinder-68c54ebb-b28b-4662-9875-2cc44aea00f6-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Lock "cinder-68c54ebb-b28b-4662-9875-2cc44aea00f6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:57 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Acquiring lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" acquired by "delete_volume" :: waited 0.012s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cf27a0-d406-4e77-b630-e60a6285e2b7]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.117s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6" returned: 0 in 0.509s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-68c54ebb-b28b-4662-9875-2cc44aea00f6" returned: 0 in 0.086s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Lock "cinder-quobyte-68c54ebb-b28b-4662-9875-2cc44aea00f6" released by "delete_volume" :: held 0.853s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:17:58 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Created reservations ['1000ad9d-8e70-4a60-ab63-075a4893f1f6', '58deded0-1a2d-403e-9ecc-38610f296861', '7e78c3de-027d-4ed6-ac62-619b4e060e08', '491e2b30-80e9-4fb9-bf0b-a6aa39bbce04'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:17:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:17:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:17:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:17:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:17:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:17:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:17:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.157s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:17:58 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:17:59 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Deleted volume successfully.
Sep 18 01:17:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e17362dd-e00d-4616-9ea7-aebf9cb36387 tempest-SnapshotsActionsTest-1213026262 None] Lock "cinder-68c54ebb-b28b-4662-9875-2cc44aea00f6-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:18:04 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Flow 'volume_create_manager' (9f6a8e60-fb9f-45c9-8bfc-de08e61553c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172a4f23-c645-48df-afce-5c21c19bd1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172a4f23-c645-48df-afce-5c21c19bd1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1368520409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc9e589-dd30-40ea-8263-327d8825764a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9ef3ea9c35411db0467ddcd9f5348e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:18:04Z,use_quota=True,user_id='1a50b736c5b345c19893bc8cee25c5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892ba361-0e58-44c4-881d-5c2e8801790c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892ba361-0e58-44c4-881d-5c2e8801790c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fc68c5-070b-4b22-9372-2a2237e1e58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fc68c5-070b-4b22-9372-2a2237e1e58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc9e589-dd30-40ea-8263-327d8825764a', 'volume_name': 'volume-bbc9e589-dd30-40ea-8263-327d8825764a', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f5d2d1-207f-4b09-8241-1514ebb3f4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f5d2d1-207f-4b09-8241-1514ebb3f4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ca2c16-8651-4498-8f08-c8f51f861c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:04 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Volume bbc9e589-dd30-40ea-8263-327d8825764a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc9e589-dd30-40ea-8263-327d8825764a', 'volume_size': 1}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1368520409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc9e589-dd30-40ea-8263-327d8825764a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9ef3ea9c35411db0467ddcd9f5348e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:18:04Z,use_quota=True,user_id='1a50b736c5b345c19893bc8cee25c5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Creating volume bbc9e589-dd30-40ea-8263-327d8825764a {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:18:04 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbc9e589-dd30-40ea-8263-327d8825764a 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:04 devstack quobyte-client[84147]: System call of process 97193 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:18:04 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=108, name=volume-bbc9e589-dd30-40ea-8263-327d8825764a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbc9e589-dd30-40ea-8263-327d8825764a 1073741824" returned: 0 in 0.324s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbc9e589-dd30-40ea-8263-327d8825764a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbc9e589-dd30-40ea-8263-327d8825764a" returned: 0 in 0.112s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] <== create_volume: return (510ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:18:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.523s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:18:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ca2c16-8651-4498-8f08-c8f51f861c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc9e589-dd30-40ea-8263-327d8825764a', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05a5810-fc25-4343-955c-61f7482fca56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:05 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Volume volume-bbc9e589-dd30-40ea-8263-327d8825764a (bbc9e589-dd30-40ea-8263-327d8825764a): created successfully
Sep 18 01:18:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05a5810-fc25-4343-955c-61f7482fca56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Flow 'volume_create_manager' (9f6a8e60-fb9f-45c9-8bfc-de08e61553c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:18:05 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-642ff091-0f7c-4b72-9e64-299f5143f8d8 tempest-VolumesServicesTestJSON-48193440 None] Created volume successfully.
Sep 18 01:18:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Acquiring lock "cinder-bbc9e589-dd30-40ea-8263-327d8825764a-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:18:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Lock "cinder-bbc9e589-dd30-40ea-8263-327d8825764a-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:18:06 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:18:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Acquiring lock "cinder-quobyte-bbc9e589-dd30-40ea-8263-327d8825764a" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:18:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Lock "cinder-quobyte-bbc9e589-dd30-40ea-8263-327d8825764a" acquired by "delete_volume" :: waited 0.015s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:18:06 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cebab2-6306-430c-9bf1-e2f34c842537]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:18:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbc9e589-dd30-40ea-8263-327d8825764a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbc9e589-dd30-40ea-8263-327d8825764a" returned: 0 in 0.383s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbc9e589-dd30-40ea-8263-327d8825764a {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbc9e589-dd30-40ea-8263-327d8825764a" returned: 0 in 0.108s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Lock "cinder-quobyte-bbc9e589-dd30-40ea-8263-327d8825764a" released by "delete_volume" :: held 0.632s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:18:07 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Created reservations ['49eae04b-deca-43f5-a93e-3fb0d68c3653', 'c9e4c31c-b32b-463a-a379-f39d53b3a77f', '6e7d5bd1-9595-477b-be64-fd02343ce943', 'f7b80449-1077-4430-b84b-ca84f6e466e7'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:18:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:18:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:18:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:18:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:18:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:18:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.119s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:07 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:18:07 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Deleted volume successfully.
Sep 18 01:18:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7b64b682-e454-4524-98a3-c9cf0fda656a tempest-VolumesServicesTestJSON-48193440 None] Lock "cinder-bbc9e589-dd30-40ea-8263-327d8825764a-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:18:13 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=78,cinder:UPDATE=97,cinder:DELETE=4,cinder:INSERT=15 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:18:13 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=74,cinder:INSERT=26,cinder:UPDATE=83,cinder:DELETE=9 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:18:13 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:18:13 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:18:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Flow 'volume_create_manager' (a6c2e658-10db-40e5-b61e-11e4cca59a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:18:13 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098385db-557d-43c7-839a-d18dfd55f93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098385db-557d-43c7-839a-d18dfd55f93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1717641978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e915efc-310b-436b-b856-5a7603239f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884d951bc4cb436783a3fb035857ce2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:18:14Z,use_quota=True,user_id='f5407c4f60844f5e96ff7014eb68af35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73bfdc5d-1c84-450c-8486-69cb1158b197),volume_type_id=73bfdc5d-1c84-450c-8486-69cb1158b197)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d8bf84-6b7b-47c5-a9de-37d45fc63a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d8bf84-6b7b-47c5-a9de-37d45fc63a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07cbc34c-5fb0-40f0-a35f-f4e073b0bb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07cbc34c-5fb0-40f0-a35f-f4e073b0bb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e915efc-310b-436b-b856-5a7603239f4d', 'volume_name': 'volume-3e915efc-310b-436b-b856-5a7603239f4d', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a3186f-2896-41cf-a379-32b750be59ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a3186f-2896-41cf-a379-32b750be59ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a99e92-ea93-4c84-984b-475e7c6c3e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:14 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Volume 3e915efc-310b-436b-b856-5a7603239f4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e915efc-310b-436b-b856-5a7603239f4d', 'volume_size': 1}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1717641978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e915efc-310b-436b-b856-5a7603239f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884d951bc4cb436783a3fb035857ce2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:18:14Z,use_quota=True,user_id='f5407c4f60844f5e96ff7014eb68af35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73bfdc5d-1c84-450c-8486-69cb1158b197),volume_type_id=73bfdc5d-1c84-450c-8486-69cb1158b197)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Creating volume 3e915efc-310b-436b-b856-5a7603239f4d {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:18:14 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e915efc-310b-436b-b856-5a7603239f4d 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:14 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=109, name=volume-3e915efc-310b-436b-b856-5a7603239f4d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e915efc-310b-436b-b856-5a7603239f4d 1073741824" returned: 0 in 0.510s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e915efc-310b-436b-b856-5a7603239f4d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e915efc-310b-436b-b856-5a7603239f4d" returned: 0 in 0.148s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] <== create_volume: return (752ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:18:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:18:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a99e92-ea93-4c84-984b-475e7c6c3e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e915efc-310b-436b-b856-5a7603239f4d', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad26ea5c-2d30-4b9a-8f64-0aa4121aeab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:15 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Volume volume-3e915efc-310b-436b-b856-5a7603239f4d (3e915efc-310b-436b-b856-5a7603239f4d): created successfully
Sep 18 01:18:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad26ea5c-2d30-4b9a-8f64-0aa4121aeab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Flow 'volume_create_manager' (a6c2e658-10db-40e5-b61e-11e4cca59a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:18:15 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-43c9fb07-a1ff-4b32-8359-6e3ab2cbbff2 req-ca785cf3-f22c-433d-9169-b53e7baf324e tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:18:15 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-ee668aab-f7d7-4695-bb9b-96598d690451 tempest-VolumeTypesAccessTest-1856723157 None] Created volume successfully.
Sep 18 01:18:15 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-43c9fb07-a1ff-4b32-8359-6e3ab2cbbff2 req-ca785cf3-f22c-433d-9169-b53e7baf324e tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:18:15 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-43c9fb07-a1ff-4b32-8359-6e3ab2cbbff2 req-ca785cf3-f22c-433d-9169-b53e7baf324e tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Terminate volume connection completed successfully.
Sep 18 01:18:15 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-43c9fb07-a1ff-4b32-8359-6e3ab2cbbff2 req-ca785cf3-f22c-433d-9169-b53e7baf324e tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Deleting attachment a7b67b08-08e6-43dc-845d-cb5f6d866059. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:18:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Acquiring lock "cinder-3e915efc-310b-436b-b856-5a7603239f4d-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:18:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Lock "cinder-3e915efc-310b-436b-b856-5a7603239f4d-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:18:16 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:18:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Acquiring lock "cinder-quobyte-3e915efc-310b-436b-b856-5a7603239f4d" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:18:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Lock "cinder-quobyte-3e915efc-310b-436b-b856-5a7603239f4d" acquired by "delete_volume" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:18:16 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[151e61e7-0d06-49aa-a104-4b21db0f503b]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:18:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e915efc-310b-436b-b856-5a7603239f4d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Acquiring lock "cinder-df114336-bae9-437f-86a5-159643fba836-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:18:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e915efc-310b-436b-b856-5a7603239f4d" returned: 0 in 0.639s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e915efc-310b-436b-b856-5a7603239f4d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:17 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Lock "cinder-df114336-bae9-437f-86a5-159643fba836-delete_volume" acquired by "delete_volume" :: waited 0.205s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:18:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3e915efc-310b-436b-b856-5a7603239f4d" returned: 0 in 0.342s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:17 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Lock "cinder-quobyte-3e915efc-310b-436b-b856-5a7603239f4d" released by "delete_volume" :: held 1.077s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:18:17 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:18:17 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Acquiring lock "cinder-quobyte-df114336-bae9-437f-86a5-159643fba836" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:18:17 devstack cinder-volume[84134]: WARNING cinder.quota [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1780619833 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1780619833, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:18:17 devstack cinder-volume[84134]: WARNING cinder.quota [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1780619833 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1780619833, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:18:17 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Lock "cinder-quobyte-df114336-bae9-437f-86a5-159643fba836" acquired by "delete_volume" :: waited 0.061s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:18:17 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[df11be43-091a-48e3-9d79-31eec0bcd699]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:18:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-df114336-bae9-437f-86a5-159643fba836 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:17 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Created reservations ['51808ed8-5ec4-45ba-b8e1-2ac6a9213337', 'c3ad86af-33fa-42d3-b57a-002f5efb0e6a', '2070e98a-0022-4a92-8e5c-a4c7c7c33286', '84e77b5e-7d4e-4fe6-a5bf-dc284407a31d'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-df114336-bae9-437f-86a5-159643fba836" returned: 0 in 0.613s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-df114336-bae9-437f-86a5-159643fba836 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.190s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:18:18 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Deleted volume successfully.
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-df114336-bae9-437f-86a5-159643fba836" returned: 0 in 0.404s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Lock "cinder-quobyte-df114336-bae9-437f-86a5-159643fba836" released by "delete_volume" :: held 1.157s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c6452598-213f-4242-b06b-6ae30630959d tempest-VolumeTypesAccessTest-1856723157 None] Lock "cinder-3e915efc-310b-436b-b856-5a7603239f4d-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Created reservations ['14a607b4-cf54-4b17-925f-5f60bde693c0', '53eadbec-c88d-4a0a-a8e4-c72d2717b2dc', '1d806779-cd5e-4c5b-91e0-92f669c5a08a', 'bfdf5ba1-c086-43ef-8b1c-ec192d4aafc4'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:18:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:18:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:18:19 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:18:19 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:18:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:18:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.143s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:19 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:18:19 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Deleted volume successfully.
Sep 18 01:18:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bd9d4fa9-1a38-4703-96cf-fa3d5d550e8b tempest-TestServerVolumeAttachScenarioOldVersion-1419368335 None] Lock "cinder-df114336-bae9-437f-86a5-159643fba836-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:18:28 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=10,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:18:29 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=16,cinder:SELECT=13,cinder:DELETE=2,cinder:INSERT=3 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:18:37 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:18:37 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:18:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Flow 'volume_create_manager' (4f2783c7-e2f4-41b6-b611-b30f351b3a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:18:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c0f997-b353-46f7-b57d-307a5394b8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c0f997-b353-46f7-b57d-307a5394b8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1799249801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed5c244-81b9-4a49-9ff7-209d8e725457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587f9081da38487ca47b544b547dd0ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:18:37Z,use_quota=True,user_id='840d5b1350834dfcbdddb87888d7d913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4aee99-6067-4d86-931d-8b2960142f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4aee99-6067-4d86-931d-8b2960142f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cc3128-540a-49d9-b35d-26e8123a90ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:37 devstack cinder-volume[84134]: DEBUG cinder.image.glance [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Creating Keystone auth plugin from conf {{(pid=84134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 01:18:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cc3128-540a-49d9-b35d-26e8123a90ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bed5c244-81b9-4a49-9ff7-209d8e725457', 'volume_name': 'volume-bed5c244-81b9-4a49-9ff7-209d8e725457', 'volume_size': 1, 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4803f5aa86a5490f958758e19b57c0e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07cf3200-362f-436f-805e-70da90459e61', 'created_at': datetime.datetime(2025, 9, 17, 22, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 22, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07cf3200-362f-436f-805e-70da90459e61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a6c9a680>}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68be3ff-f23f-4c25-8a63-9eb9db9333e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68be3ff-f23f-4c25-8a63-9eb9db9333e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577863b1-71ce-442a-ac12-fa0dec7cebe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:37 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Volume bed5c244-81b9-4a49-9ff7-209d8e725457: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bed5c244-81b9-4a49-9ff7-209d8e725457', 'volume_size': 1, 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4803f5aa86a5490f958758e19b57c0e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07cf3200-362f-436f-805e-70da90459e61', 'created_at': datetime.datetime(2025, 9, 17, 22, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 22, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07cf3200-362f-436f-805e-70da90459e61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a6c9a680>}
Sep 18 01:18:37 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Cloning bed5c244-81b9-4a49-9ff7-209d8e725457 from image 07cf3200-362f-436f-805e-70da90459e61  at location (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]). {{(pid=84134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 01:18:38 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_jhskur1ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 01:18:38 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 01:18:38 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a126cabd-4fcb-4ac1-bd62-53dadee61592]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:18:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_jhskur1ndevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:38 devstack sudo[97342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_jhskur1ndevstack@QuobyteHD
Sep 18 01:18:38 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:18:40 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root
Sep 18 01:18:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_jhskur1ndevstack@QuobyteHD" returned: 0 in 2.510s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:40 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Temporary image 07cf3200-362f-436f-805e-70da90459e61 is fetched for user 840d5b1350834dfcbdddb87888d7d913. {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 01:18:41 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9490dd3a-0558-4f83-91e5-a4d3acbd8d76]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:18:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_jhskur1ndevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:41 devstack sudo[97348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_jhskur1ndevstack@QuobyteHD
Sep 18 01:18:41 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:18:43 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root
Sep 18 01:18:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_jhskur1ndevstack@QuobyteHD" returned: 0 in 2.542s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:18:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:18:43 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1799249801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed5c244-81b9-4a49-9ff7-209d8e725457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587f9081da38487ca47b544b547dd0ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:18:37Z,use_quota=True,user_id='840d5b1350834dfcbdddb87888d7d913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:18:43 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Creating volume bed5c244-81b9-4a49-9ff7-209d8e725457 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:18:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:18:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:18:43 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:18:43 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:18:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:18:43 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:18:43 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:18:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:44 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=110, name=volume-bed5c244-81b9-4a49-9ff7-209d8e725457, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:18:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457 1073741824" returned: 0 in 0.308s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457" returned: 0 in 0.113s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:44 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] <== create_volume: return (537ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:18:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.577s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:18:44 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Attempting download of 07cf3200-362f-436f-805e-70da90459e61 ((None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}])) to volume bed5c244-81b9-4a49-9ff7-209d8e725457. {{(pid=84134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 01:18:44 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66f7c24-74d0-4db0-af8d-1e46c9455c79]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:18:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_xlv943we {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_xlv943we" returned: 0 in 0.440s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_xlv943we {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_xlv943we" returned: 1 in 0.536s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_xlv943we' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:18:46 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[257fdf80-37b0-4193-bae5-f75329b50d27]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:18:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_jhskur1ndevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_jhskur1ndevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:46 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] 07cf3200-362f-436f-805e-70da90459e61 was qcow2, converting to raw {{(pid=84134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 01:18:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_jhskur1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:46 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=110, name=volume-bed5c244-81b9-4a49-9ff7-209d8e725457, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:18:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_jhskur1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457" returned: 0 in 0.995s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:47 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_jhskur1ndevstack@QuobyteHD, size 112.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457 {{(pid=84134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 01:18:47 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Converted 112.00 MB image at 109.20 MB/s
Sep 18 01:18:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457 1G" returned: 0 in 0.144s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:47 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[042d8abd-1fe4-4ac4-835d-1df4aa6b67a2]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:18:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457" returned: 0 in 0.415s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457" returned: 1 in 0.419s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:18:48 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Downloaded image 07cf3200-362f-436f-805e-70da90459e61 ((None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}])) to volume bed5c244-81b9-4a49-9ff7-209d8e725457 successfully. {{(pid=84134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 01:18:48 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Temporary image 07cf3200-362f-436f-805e-70da90459e61 for user 840d5b1350834dfcbdddb87888d7d913 is deleted. {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 01:18:48 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Marking volume bed5c244-81b9-4a49-9ff7-209d8e725457 as bootable. {{(pid=84134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 01:18:48 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Copying metadata from image 07cf3200-362f-436f-805e-70da90459e61 to bed5c244-81b9-4a49-9ff7-209d8e725457. {{(pid=84134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 01:18:48 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Creating volume glance metadata for volume bed5c244-81b9-4a49-9ff7-209d8e725457 backed by image 07cf3200-362f-436f-805e-70da90459e61 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 01:18:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577863b1-71ce-442a-ac12-fa0dec7cebe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed5c244-81b9-4a49-9ff7-209d8e725457', 'volume_size': 1, 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4803f5aa86a5490f958758e19b57c0e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07cf3200-362f-436f-805e-70da90459e61', 'created_at': datetime.datetime(2025, 9, 17, 22, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 22, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07cf3200-362f-436f-805e-70da90459e61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a6c9a680>}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde21c91-a10e-42d2-8d7f-65fb7c725f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:49 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Volume volume-bed5c244-81b9-4a49-9ff7-209d8e725457 (bed5c244-81b9-4a49-9ff7-209d8e725457): created successfully
Sep 18 01:18:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde21c91-a10e-42d2-8d7f-65fb7c725f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Flow 'volume_create_manager' (4f2783c7-e2f4-41b6-b611-b30f351b3a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:18:49 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8937c641-e543-4d0d-b84b-129290165631 tempest-VolumesImageMetadata-78398433 None] Created volume successfully.
Sep 18 01:18:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Acquiring lock "cinder-bed5c244-81b9-4a49-9ff7-209d8e725457-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:18:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Lock "cinder-bed5c244-81b9-4a49-9ff7-209d8e725457-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:18:50 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:18:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Acquiring lock "cinder-quobyte-bed5c244-81b9-4a49-9ff7-209d8e725457" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:18:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Lock "cinder-quobyte-bed5c244-81b9-4a49-9ff7-209d8e725457" acquired by "delete_volume" :: waited 0.018s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:18:51 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[506c6854-2c4f-420f-83ee-cf5ee3274544]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:18:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457" returned: 0 in 0.503s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457" returned: 1 in 0.462s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:18:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bed5c244-81b9-4a49-9ff7-209d8e725457" returned: 0 in 0.112s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Lock "cinder-quobyte-bed5c244-81b9-4a49-9ff7-209d8e725457" released by "delete_volume" :: held 1.353s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:18:52 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Created reservations ['4a50f67a-8272-4b4d-8d7c-ac7e7fc63424', 'aa87818c-508a-48a4-976e-88fe7c243661', '53897a4c-4090-48cf-8ba2-cdde4092a54c', '1d99af93-c306-45cc-b4bd-c31869e4306f'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:18:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:18:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:18:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:18:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:18:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:18:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.097s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:52 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:18:52 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Deleted volume successfully.
Sep 18 01:18:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-29b5fa53-9fb4-4bc6-bd23-02c8e1835633 tempest-VolumesImageMetadata-78398433 None] Lock "cinder-bed5c244-81b9-4a49-9ff7-209d8e725457-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:18:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:18:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:18:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:18:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:18:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:18:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:18:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.233s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:18:58 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Flow 'volume_create_manager' (3fe9a469-acc3-4505-94fd-4feb69760fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91333c1-9fdc-4b0b-89cd-03522e1c9828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91333c1-9fdc-4b0b-89cd-03522e1c9828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-819691630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02592a4d-2be9-4d30-9e8f-994dd4bf2a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2b1240000b4333ac46461b1c56f7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:18:58Z,use_quota=True,user_id='567ee20608af4cfd8f2ac804e9bbf5e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b283ebb2-7f70-4101-bb1b-ed74a84c6b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b283ebb2-7f70-4101-bb1b-ed74a84c6b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c575ef-64c5-4279-bb49-c7bcf8ecd8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c575ef-64c5-4279-bb49-c7bcf8ecd8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02592a4d-2be9-4d30-9e8f-994dd4bf2a93', 'volume_name': 'volume-02592a4d-2be9-4d30-9e8f-994dd4bf2a93', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb5038e-6e4d-402f-9f7d-b187441cde8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb5038e-6e4d-402f-9f7d-b187441cde8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030795cc-57c2-4e85-a4bb-0f7fa315308a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:58 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Volume 02592a4d-2be9-4d30-9e8f-994dd4bf2a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02592a4d-2be9-4d30-9e8f-994dd4bf2a93', 'volume_size': 1}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-819691630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02592a4d-2be9-4d30-9e8f-994dd4bf2a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2b1240000b4333ac46461b1c56f7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:18:58Z,use_quota=True,user_id='567ee20608af4cfd8f2ac804e9bbf5e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Creating volume 02592a4d-2be9-4d30-9e8f-994dd4bf2a93 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:18:58 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:18:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-02592a4d-2be9-4d30-9e8f-994dd4bf2a93 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:59 devstack quobyte-client[84147]: System call of process 97400 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:18:59 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=111, name=volume-02592a4d-2be9-4d30-9e8f-994dd4bf2a93, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:18:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-02592a4d-2be9-4d30-9e8f-994dd4bf2a93 1073741824" returned: 0 in 0.413s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-02592a4d-2be9-4d30-9e8f-994dd4bf2a93 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:18:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-02592a4d-2be9-4d30-9e8f-994dd4bf2a93" returned: 0 in 0.220s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:18:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] <== create_volume: return (723ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:18:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:18:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030795cc-57c2-4e85-a4bb-0f7fa315308a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02592a4d-2be9-4d30-9e8f-994dd4bf2a93', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f40f46-a0dd-4951-914f-b16e5e879e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:18:59 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Volume volume-02592a4d-2be9-4d30-9e8f-994dd4bf2a93 (02592a4d-2be9-4d30-9e8f-994dd4bf2a93): created successfully
Sep 18 01:18:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f40f46-a0dd-4951-914f-b16e5e879e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:18:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Flow 'volume_create_manager' (3fe9a469-acc3-4505-94fd-4feb69760fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:18:59 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5c0fbca0-62ac-4e69-a17f-3e8b7005e5c5 tempest-VolumesTransfersV357Test-413459305 None] Created volume successfully.
Sep 18 01:19:01 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-1d8088ce-3216-478c-864d-2f30f8a108b6 tempest-VolumesTransfersV357Test-899359646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:01 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-1d8088ce-3216-478c-864d-2f30f8a108b6 tempest-VolumesTransfersV357Test-899359646 None] Transfer volume completed successfully.
Sep 18 01:19:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Acquiring lock "cinder-02592a4d-2be9-4d30-9e8f-994dd4bf2a93-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:19:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Lock "cinder-02592a4d-2be9-4d30-9e8f-994dd4bf2a93-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:19:02 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Acquiring lock "cinder-quobyte-02592a4d-2be9-4d30-9e8f-994dd4bf2a93" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:19:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Lock "cinder-quobyte-02592a4d-2be9-4d30-9e8f-994dd4bf2a93" acquired by "delete_volume" :: waited 0.014s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:19:02 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba85cea-4fcb-45d6-8039-eb360eeafaf7]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-02592a4d-2be9-4d30-9e8f-994dd4bf2a93 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-02592a4d-2be9-4d30-9e8f-994dd4bf2a93" returned: 0 in 0.522s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-02592a4d-2be9-4d30-9e8f-994dd4bf2a93 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-02592a4d-2be9-4d30-9e8f-994dd4bf2a93" returned: 0 in 0.102s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Lock "cinder-quobyte-02592a4d-2be9-4d30-9e8f-994dd4bf2a93" released by "delete_volume" :: held 0.817s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:19:03 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Created reservations ['67902927-ad6c-4e09-a548-df464bdff020', '0135c01d-6c0c-43de-9f5c-3b2dc600f6dd', '1722a4df-3839-4f2b-8a0e-bb62affd71e9', 'c54c207b-b538-4dec-a6bd-1a296588c10d'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:19:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:19:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:19:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.092s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:03 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:19:03 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Deleted volume successfully.
Sep 18 01:19:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-56984e29-8784-437d-b4e8-6f31e8100207 tempest-VolumesTransfersV357Test-889924410 None] Lock "cinder-02592a4d-2be9-4d30-9e8f-994dd4bf2a93-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:19:04 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:04 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Flow 'volume_create_manager' (ccf22a2d-eb95-48ca-a221-f8eaea701a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7f608d-4d8c-4ce2-a1a2-02303e28a527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7f608d-4d8c-4ce2-a1a2-02303e28a527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-954943000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d06eaff-36b6-4d20-900b-e12298e9c2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2b1240000b4333ac46461b1c56f7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:19:05Z,use_quota=True,user_id='567ee20608af4cfd8f2ac804e9bbf5e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76f50ed-ce45-4db9-8e59-c51dbf584b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76f50ed-ce45-4db9-8e59-c51dbf584b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24fa4541-03f6-4705-a51e-cd910f84042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24fa4541-03f6-4705-a51e-cd910f84042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d06eaff-36b6-4d20-900b-e12298e9c2ce', 'volume_name': 'volume-3d06eaff-36b6-4d20-900b-e12298e9c2ce', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0bda995-9688-4bc9-9b92-fdf3e7ffff7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0bda995-9688-4bc9-9b92-fdf3e7ffff7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6268641-a26d-4eb3-8287-5e1cfbf168eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:05 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Volume 3d06eaff-36b6-4d20-900b-e12298e9c2ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d06eaff-36b6-4d20-900b-e12298e9c2ce', 'volume_size': 1}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-954943000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d06eaff-36b6-4d20-900b-e12298e9c2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2b1240000b4333ac46461b1c56f7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:19:05Z,use_quota=True,user_id='567ee20608af4cfd8f2ac804e9bbf5e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Creating volume 3d06eaff-36b6-4d20-900b-e12298e9c2ce {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:19:05 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3d06eaff-36b6-4d20-900b-e12298e9c2ce 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:05 devstack quobyte-client[84147]: System call of process 97410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:19:05 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=112, name=volume-3d06eaff-36b6-4d20-900b-e12298e9c2ce, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3d06eaff-36b6-4d20-900b-e12298e9c2ce 1073741824" returned: 0 in 0.402s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3d06eaff-36b6-4d20-900b-e12298e9c2ce {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3d06eaff-36b6-4d20-900b-e12298e9c2ce" returned: 0 in 0.102s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] <== create_volume: return (601ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:19:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.616s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:06 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6268641-a26d-4eb3-8287-5e1cfbf168eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d06eaff-36b6-4d20-900b-e12298e9c2ce', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:06 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb8a7c7-c470-4b35-9b7c-9291943cb0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:06 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Volume volume-3d06eaff-36b6-4d20-900b-e12298e9c2ce (3d06eaff-36b6-4d20-900b-e12298e9c2ce): created successfully
Sep 18 01:19:06 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb8a7c7-c470-4b35-9b7c-9291943cb0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:06 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Flow 'volume_create_manager' (ccf22a2d-eb95-48ca-a221-f8eaea701a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:19:06 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3979034b-d659-4db0-87e7-b7cb3e27b4e8 tempest-VolumesTransfersV357Test-413459305 None] Created volume successfully.
Sep 18 01:19:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Acquiring lock "cinder-3d06eaff-36b6-4d20-900b-e12298e9c2ce-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:19:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Lock "cinder-3d06eaff-36b6-4d20-900b-e12298e9c2ce-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:19:07 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Acquiring lock "cinder-quobyte-3d06eaff-36b6-4d20-900b-e12298e9c2ce" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:19:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Lock "cinder-quobyte-3d06eaff-36b6-4d20-900b-e12298e9c2ce" acquired by "delete_volume" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:19:07 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae30401-5d92-451d-a973-823e24d1bf20]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3d06eaff-36b6-4d20-900b-e12298e9c2ce {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3d06eaff-36b6-4d20-900b-e12298e9c2ce" returned: 0 in 0.459s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3d06eaff-36b6-4d20-900b-e12298e9c2ce {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-3d06eaff-36b6-4d20-900b-e12298e9c2ce" returned: 0 in 0.173s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Lock "cinder-quobyte-3d06eaff-36b6-4d20-900b-e12298e9c2ce" released by "delete_volume" :: held 0.776s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:19:08 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Created reservations ['ced0c8eb-d68c-465d-a4d4-f613b3959526', '4b490b6f-746e-4c0e-972a-42297fa497cc', '5473b55c-a8bd-42b5-8dbc-a134eb970290', '13ddd0fd-fdcb-4474-883b-f9aee5529954'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:19:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:08 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:19:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:19:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.093s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:09 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:19:09 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Deleted volume successfully.
Sep 18 01:19:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8cc94095-665e-450b-8295-327b1dd719e0 tempest-VolumesTransfersV357Test-889924410 None] Lock "cinder-3d06eaff-36b6-4d20-900b-e12298e9c2ce-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:19:17 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:17 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:19:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Flow 'volume_create_manager' (c57b095b-8d84-4fe3-9190-00945e9c95e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:19:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c40b8e6-cecd-46af-8bf9-6d2a9cb8a6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c40b8e6-cecd-46af-8bf9-6d2a9cb8a6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1755313955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e156677a-35a9-4343-9100-564ac7cc0f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd716ed178424e42bf9fc6e1c68b66dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:19:17Z,use_quota=True,user_id='a981f7f100e14f63991b99b2d734bdf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4710dfba-9b1a-40e6-bea2-8753b8a2123e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4710dfba-9b1a-40e6-bea2-8753b8a2123e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739534d6-26c3-4bbb-9beb-de1b03bd7832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:17 devstack cinder-volume[84134]: DEBUG cinder.image.glance [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Creating Keystone auth plugin from conf {{(pid=84134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 01:19:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739534d6-26c3-4bbb-9beb-de1b03bd7832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e156677a-35a9-4343-9100-564ac7cc0f38', 'volume_name': 'volume-e156677a-35a9-4343-9100-564ac7cc0f38', 'volume_size': 1, 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4803f5aa86a5490f958758e19b57c0e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07cf3200-362f-436f-805e-70da90459e61', 'created_at': datetime.datetime(2025, 9, 17, 22, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 22, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07cf3200-362f-436f-805e-70da90459e61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4b11ead70>}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b36081-9d46-4e8d-a2bf-5ff9af028aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b36081-9d46-4e8d-a2bf-5ff9af028aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:17 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfeec128-66bc-43a6-816d-4fb69ab823ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:17 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Volume e156677a-35a9-4343-9100-564ac7cc0f38: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e156677a-35a9-4343-9100-564ac7cc0f38', 'volume_size': 1, 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4803f5aa86a5490f958758e19b57c0e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07cf3200-362f-436f-805e-70da90459e61', 'created_at': datetime.datetime(2025, 9, 17, 22, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 22, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07cf3200-362f-436f-805e-70da90459e61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4b11ead70>}
Sep 18 01:19:17 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Cloning e156677a-35a9-4343-9100-564ac7cc0f38 from image 07cf3200-362f-436f-805e-70da90459e61  at location (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]). {{(pid=84134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 01:19:18 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_4q_o84zzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 01:19:18 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 01:19:18 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b6a460-1ec4-4bdd-894b-38e9cb30c7e9]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_4q_o84zzdevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:18 devstack sudo[97454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_4q_o84zzdevstack@QuobyteHD
Sep 18 01:19:18 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:19:20 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root
Sep 18 01:19:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_4q_o84zzdevstack@QuobyteHD" returned: 0 in 2.174s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:20 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Temporary image 07cf3200-362f-436f-805e-70da90459e61 is fetched for user a981f7f100e14f63991b99b2d734bdf2. {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 01:19:20 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9959b991-8b75-4ba9-bdec-45e085b30653]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_4q_o84zzdevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:21 devstack sudo[97462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_4q_o84zzdevstack@QuobyteHD
Sep 18 01:19:21 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:19:23 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:23 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Flow 'volume_create_manager' (8327d377-4e7b-4020-9faa-e1399ebdcaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd84d77-564e-4fa2-a6ab-5ad2091d851a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_4q_o84zzdevstack@QuobyteHD" returned: 0 in 2.402s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1755313955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e156677a-35a9-4343-9100-564ac7cc0f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd716ed178424e42bf9fc6e1c68b66dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:19:17Z,use_quota=True,user_id='a981f7f100e14f63991b99b2d734bdf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Creating volume e156677a-35a9-4343-9100-564ac7cc0f38 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:19:23 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:23 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=113, name=volume-e156677a-35a9-4343-9100-564ac7cc0f38, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd84d77-564e-4fa2-a6ab-5ad2091d851a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2129278088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84aca45-16a9-44c8-906e-1327bfa1d9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de5aaed899a407993292e5912ea8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:19:22Z,use_quota=True,user_id='81bf5f6b4ca24575b621c03bd19190ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf9b474-8b5d-4735-99d6-79491da2ffa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf9b474-8b5d-4735-99d6-79491da2ffa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f81dd6a-693a-4e35-aeac-36e3e888ae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG cinder.image.glance [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Creating Keystone auth plugin from conf {{(pid=84134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 1073741824" returned: 0 in 0.511s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38" returned: 0 in 0.093s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] <== create_volume: return (656ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:19:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:24 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Attempting download of 07cf3200-362f-436f-805e-70da90459e61 ((None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}])) to volume e156677a-35a9-4343-9100-564ac7cc0f38. {{(pid=84134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 01:19:24 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b1f9af-9a3e-4eb1-be94-e45a5bf8dfa1]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_ksg9zejo {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f81dd6a-693a-4e35-aeac-36e3e888ae6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c84aca45-16a9-44c8-906e-1327bfa1d9b1', 'volume_name': 'volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1', 'volume_size': 1, 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4803f5aa86a5490f958758e19b57c0e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07cf3200-362f-436f-805e-70da90459e61', 'created_at': datetime.datetime(2025, 9, 17, 22, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 22, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07cf3200-362f-436f-805e-70da90459e61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a6bc7220>}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99305488-b850-498f-b98a-2914e413e965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99305488-b850-498f-b98a-2914e413e965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224f5d99-7749-465d-b59e-3795866a1c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:24 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Volume c84aca45-16a9-44c8-906e-1327bfa1d9b1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1', 'volume_size': 1, 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4803f5aa86a5490f958758e19b57c0e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07cf3200-362f-436f-805e-70da90459e61', 'created_at': datetime.datetime(2025, 9, 17, 22, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 22, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07cf3200-362f-436f-805e-70da90459e61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a6bc7220>}
Sep 18 01:19:24 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Cloning c84aca45-16a9-44c8-906e-1327bfa1d9b1 from image 07cf3200-362f-436f-805e-70da90459e61  at location (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]). {{(pid=84134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 01:19:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_ksg9zejo" returned: 0 in 0.520s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_ksg9zejo {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:25 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_vc2np7u3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 01:19:25 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 01:19:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_ksg9zejo" returned: 1 in 0.492s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61_ksg9zejo' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:19:25 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeac436c-cc0e-4956-8a38-206b4ba3cbd4]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_4q_o84zzdevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:25 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ec6495-f7b0-4252-830d-3f3b6ca89ce7]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_vc2np7u3devstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_4q_o84zzdevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:25 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] 07cf3200-362f-436f-805e-70da90459e61 was qcow2, converting to raw {{(pid=84134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 01:19:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_4q_o84zzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:25 devstack quobyte-client[84147]: System call of process 97484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:19:25 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=113, name=volume-e156677a-35a9-4343-9100-564ac7cc0f38, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:19:26 devstack sudo[97481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_vc2np7u3devstack@QuobyteHD
Sep 18 01:19:26 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:19:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_4q_o84zzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38" returned: 0 in 0.992s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:26 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_4q_o84zzdevstack@QuobyteHD, size 112.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 {{(pid=84134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 01:19:26 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Converted 112.00 MB image at 108.04 MB/s
Sep 18 01:19:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 1G" returned: 0 in 0.148s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:27 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e566a7c-da1f-4e72-9f3b-670c34fb0f5b]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:27 devstack quobyte-client[84147]: System call of process 97498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:19:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38" returned: 0 in 0.681s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:27 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_vc2np7u3devstack@QuobyteHD" returned: 0 in 2.426s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Temporary image 07cf3200-362f-436f-805e-70da90459e61 is fetched for user 81bf5f6b4ca24575b621c03bd19190ee. {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc8ceba-72cd-4c9e-a43c-b4e97c6edcb1]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_vc2np7u3devstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38" returned: 1 in 0.567s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Downloaded image 07cf3200-362f-436f-805e-70da90459e61 ((None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}])) to volume e156677a-35a9-4343-9100-564ac7cc0f38 successfully. {{(pid=84134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Temporary image 07cf3200-362f-436f-805e-70da90459e61 for user a981f7f100e14f63991b99b2d734bdf2 is deleted. {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Marking volume e156677a-35a9-4343-9100-564ac7cc0f38 as bootable. {{(pid=84134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Copying metadata from image 07cf3200-362f-436f-805e-70da90459e61 to e156677a-35a9-4343-9100-564ac7cc0f38. {{(pid=84134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Creating volume glance metadata for volume e156677a-35a9-4343-9100-564ac7cc0f38 backed by image 07cf3200-362f-436f-805e-70da90459e61 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfeec128-66bc-43a6-816d-4fb69ab823ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e156677a-35a9-4343-9100-564ac7cc0f38', 'volume_size': 1, 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4803f5aa86a5490f958758e19b57c0e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07cf3200-362f-436f-805e-70da90459e61', 'created_at': datetime.datetime(2025, 9, 17, 22, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 22, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07cf3200-362f-436f-805e-70da90459e61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4b11ead70>}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c54edcd-ba9b-4e54-b14e-a8b6ac1086af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:28 devstack sudo[97506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_vc2np7u3devstack@QuobyteHD
Sep 18 01:19:28 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:19:28 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Volume volume-e156677a-35a9-4343-9100-564ac7cc0f38 (e156677a-35a9-4343-9100-564ac7cc0f38): created successfully
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c54edcd-ba9b-4e54-b14e-a8b6ac1086af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Flow 'volume_create_manager' (c57b095b-8d84-4fe3-9190-00945e9c95e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:19:28 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-a65cbfc2-5c8f-4cc5-9014-c2e50daa123a tempest-VolumesExtendTest-117464597 None] Created volume successfully.
Sep 18 01:19:30 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-a9c2bc6f-b7b6-4b60-bc8f-2273b595d443 tempest-VolumesExtendTest-117464597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a9c2bc6f-b7b6-4b60-bc8f-2273b595d443 tempest-VolumesExtendTest-117464597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a9c2bc6f-b7b6-4b60-bc8f-2273b595d443 tempest-VolumesExtendTest-117464597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:30 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[631adcd8-1f1d-427d-9e85-e49891a82179]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a9c2bc6f-b7b6-4b60-bc8f-2273b595d443 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:30 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root
Sep 18 01:19:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_vc2np7u3devstack@QuobyteHD" returned: 0 in 2.286s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a9c2bc6f-b7b6-4b60-bc8f-2273b595d443 tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38" returned: 0 in 0.513s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a9c2bc6f-b7b6-4b60-bc8f-2273b595d443 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a9c2bc6f-b7b6-4b60-bc8f-2273b595d443 tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38" returned: 1 in 0.352s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a9c2bc6f-b7b6-4b60-bc8f-2273b595d443 tempest-VolumesExtendTest-117464597 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a9c2bc6f-b7b6-4b60-bc8f-2273b595d443 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 2G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a9c2bc6f-b7b6-4b60-bc8f-2273b595d443 tempest-VolumesExtendTest-117464597 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 2G" returned: 0 in 0.145s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a9c2bc6f-b7b6-4b60-bc8f-2273b595d443 tempest-VolumesExtendTest-117464597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.154s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2129278088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84aca45-16a9-44c8-906e-1327bfa1d9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de5aaed899a407993292e5912ea8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:19:22Z,use_quota=True,user_id='81bf5f6b4ca24575b621c03bd19190ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Creating volume c84aca45-16a9-44c8-906e-1327bfa1d9b1 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:19:31 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=35,cinder:INSERT=19,cinder:SELECT=29,cinder:DELETE=3 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:19:31 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=47,cinder:UPDATE=37,cinder:INSERT=20,cinder:DELETE=4 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:19:31 devstack quobyte-client[84147]: System call of process 97519 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:19:31 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=114, name=volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:19:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 1073741824" returned: 0 in 0.410s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:32 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-a9c2bc6f-b7b6-4b60-bc8f-2273b595d443 tempest-VolumesExtendTest-117464597 None] Extend volume completed successfully.
Sep 18 01:19:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1" returned: 0 in 0.226s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:32 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] <== create_volume: return (671ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:19:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:32 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Attempting download of 07cf3200-362f-436f-805e-70da90459e61 ((None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}])) to volume c84aca45-16a9-44c8-906e-1327bfa1d9b1. {{(pid=84134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 01:19:32 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a913e2c0-5b43-467f-8d13-0598bb873d1f]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61__0uvbsq6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:32 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Acquiring lock "cinder-e156677a-35a9-4343-9100-564ac7cc0f38-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:19:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61__0uvbsq6" returned: 0 in 0.476s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61__0uvbsq6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:33 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Lock "cinder-e156677a-35a9-4343-9100-564ac7cc0f38-delete_volume" acquired by "delete_volume" :: waited 0.236s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:19:33 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:33 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Acquiring lock "cinder-quobyte-e156677a-35a9-4343-9100-564ac7cc0f38" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:19:33 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Lock "cinder-quobyte-e156677a-35a9-4343-9100-564ac7cc0f38" acquired by "delete_volume" :: waited 0.035s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:19:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61__0uvbsq6" returned: 1 in 0.527s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07cf3200-362f-436f-805e-70da90459e61__0uvbsq6' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:19:33 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7944654f-7c32-4a72-b257-503b3b29b425]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_vc2np7u3devstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:33 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d166d1-0d66-402e-b51b-b03769dbd10b]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_vc2np7u3devstack@QuobyteHD" returned: 0 in 0.476s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:34 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] 07cf3200-362f-436f-805e-70da90459e61 was qcow2, converting to raw {{(pid=84134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 01:19:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_vc2np7u3devstack@QuobyteHD /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38" returned: 0 in 0.492s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:34 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=114, name=volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:19:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38" returned: 1 in 0.494s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:19:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e156677a-35a9-4343-9100-564ac7cc0f38" returned: 0 in 0.117s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_vc2np7u3devstack@QuobyteHD /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1" returned: 0 in 0.969s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:35 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_07cf3200-362f-436f-805e-70da90459e61_vc2np7u3devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 {{(pid=84134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 01:19:35 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Converted 112.00 MB image at 112.00 MB/s
Sep 18 01:19:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:35 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Lock "cinder-quobyte-e156677a-35a9-4343-9100-564ac7cc0f38" released by "delete_volume" :: held 1.647s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:19:35 devstack quobyte-client[84147]: System call of process 97548 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:19:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 1G" returned: 0 in 0.312s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:35 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d715af-6d3f-43ef-9ee5-89c65ad61e81]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:35 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Created reservations ['3d9de880-11b7-45e3-bec0-f3216fbad629', '701b10a3-977b-4dff-b39d-d4447839e84c', 'c5fe2729-1b63-4cb7-aca1-bb09496f169b', '2e4c6e37-8155-44b1-82b3-31f18b8425fd'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1" returned: 0 in 0.578s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.264s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:19:36 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Deleted volume successfully.
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-dc9227e7-9e65-4027-8c7f-f681f1f106c6 tempest-VolumesExtendTest-117464597 None] Lock "cinder-e156677a-35a9-4343-9100-564ac7cc0f38-delete_volume" released by "delete_volume" :: held 3.624s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1" returned: 1 in 0.752s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Downloaded image 07cf3200-362f-436f-805e-70da90459e61 ((None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}])) to volume c84aca45-16a9-44c8-906e-1327bfa1d9b1 successfully. {{(pid=84134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Temporary image 07cf3200-362f-436f-805e-70da90459e61 for user 81bf5f6b4ca24575b621c03bd19190ee is deleted. {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 01:19:36 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Marking volume c84aca45-16a9-44c8-906e-1327bfa1d9b1 as bootable. {{(pid=84134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 01:19:37 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Flow 'volume_create_manager' (880fdee5-4637-4480-912a-78da9d0a54e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08c7d8c-5aa0-44e1-8372-f3c36231d076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Copying metadata from image 07cf3200-362f-436f-805e-70da90459e61 to c84aca45-16a9-44c8-906e-1327bfa1d9b1. {{(pid=84134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Creating volume glance metadata for volume c84aca45-16a9-44c8-906e-1327bfa1d9b1 backed by image 07cf3200-362f-436f-805e-70da90459e61 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08c7d8c-5aa0-44e1-8372-f3c36231d076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-71795019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e93348c-e67b-4e0a-95ce-ad2f2cb33c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd716ed178424e42bf9fc6e1c68b66dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:19:37Z,use_quota=True,user_id='a981f7f100e14f63991b99b2d734bdf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb85c95d-178c-4202-a29f-e4cc78aec7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb85c95d-178c-4202-a29f-e4cc78aec7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f15ee84-e9a7-4378-8902-c36c501fedb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f15ee84-e9a7-4378-8902-c36c501fedb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e93348c-e67b-4e0a-95ce-ad2f2cb33c27', 'volume_name': 'volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc86dac-ed78-4860-a7c6-ea1342a9540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc86dac-ed78-4860-a7c6-ea1342a9540e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb95adf-64bb-459a-af88-a0c891dd1f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:37 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Volume 2e93348c-e67b-4e0a-95ce-ad2f2cb33c27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27', 'volume_size': 1}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-71795019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e93348c-e67b-4e0a-95ce-ad2f2cb33c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd716ed178424e42bf9fc6e1c68b66dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:19:37Z,use_quota=True,user_id='a981f7f100e14f63991b99b2d734bdf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Creating volume 2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:19:37 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:37 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=115, name=volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 1073741824" returned: 0 in 0.362s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27" returned: 0 in 0.271s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] <== create_volume: return (683ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224f5d99-7749-465d-b59e-3795866a1c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1', 'volume_size': 1, 'image_id': '07cf3200-362f-436f-805e-70da90459e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07cf3200-362f-436f-805e-70da90459e61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4803f5aa86a5490f958758e19b57c0e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07cf3200-362f-436f-805e-70da90459e61', 'created_at': datetime.datetime(2025, 9, 17, 22, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 22, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07cf3200-362f-436f-805e-70da90459e61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a6bc7220>}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00081921-a3d1-4f17-becc-9a9e3add9b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:37 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Volume volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 (c84aca45-16a9-44c8-906e-1327bfa1d9b1): created successfully
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00081921-a3d1-4f17-becc-9a9e3add9b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Flow 'volume_create_manager' (8327d377-4e7b-4020-9faa-e1399ebdcaf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:19:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb95adf-64bb-459a-af88-a0c891dd1f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b483f3b4-fb0e-4d9e-b8d2-b9cec942ea42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:38 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-50692a51-3abf-401c-96aa-9c977fac9519 tempest-TestShelveInstance-1967069160 None] Created volume successfully.
Sep 18 01:19:38 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Volume volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 (2e93348c-e67b-4e0a-95ce-ad2f2cb33c27): created successfully
Sep 18 01:19:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b483f3b4-fb0e-4d9e-b8d2-b9cec942ea42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Flow 'volume_create_manager' (880fdee5-4637-4480-912a-78da9d0a54e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:19:38 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-af0fd7cb-aa30-4664-a76b-bdae41ca24f6 tempest-VolumesExtendTest-117464597 None] Created volume successfully.
Sep 18 01:19:39 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] Creating offline snapshot 1b60407c-c4e9-41fc-8fd9-46de61020d95 of volume 2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:19:39 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d0c87f-982a-4ac5-82f3-dbcbd79a3f64]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27" returned: 0 in 0.468s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:40 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=116, name=volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95 1G" returned: 0 in 0.225s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] CMD "qemu-img rebase -u -b volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95" returned: 0 in 0.178s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95" returned: 0 in 0.128s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95" returned: 0 in 0.103s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.info" returned: 0 in 0.111s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.info" returned: 0 in 0.095s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.698s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:41 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-2fc52393-a145-4fd5-8872-d50d7546326d tempest-VolumesExtendTest-117464597 None] Create snapshot completed successfully
Sep 18 01:19:41 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-c8d6a25a-4745-4da5-91ff-85be863853c7 tempest-VolumesExtendTest-117464597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c8d6a25a-4745-4da5-91ff-85be863853c7 tempest-VolumesExtendTest-117464597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c8d6a25a-4745-4da5-91ff-85be863853c7 tempest-VolumesExtendTest-117464597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:41 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[74794938-35f6-46c9-ab33-44278d4c0882]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c8d6a25a-4745-4da5-91ff-85be863853c7 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c8d6a25a-4745-4da5-91ff-85be863853c7 tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27" returned: 0 in 0.473s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c8d6a25a-4745-4da5-91ff-85be863853c7 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95 2G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c8d6a25a-4745-4da5-91ff-85be863853c7 tempest-VolumesExtendTest-117464597 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95 2G" returned: 0 in 0.191s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c8d6a25a-4745-4da5-91ff-85be863853c7 tempest-VolumesExtendTest-117464597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.754s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:42 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-c8d6a25a-4745-4da5-91ff-85be863853c7 tempest-VolumesExtendTest-117464597 None] Extend volume completed successfully.
Sep 18 01:19:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Acquiring lock "cinder-1b60407c-c4e9-41fc-8fd9-46de61020d95-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:19:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Lock "cinder-1b60407c-c4e9-41fc-8fd9-46de61020d95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:19:42 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Acquiring lock "cinder-quobyte-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:19:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Lock "cinder-quobyte-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:19:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Acquiring lock "cinder-quobyte-1b60407c-c4e9-41fc-8fd9-46de61020d95" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:19:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Lock "cinder-quobyte-1b60407c-c4e9-41fc-8fd9-46de61020d95" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:19:43 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Deleting offline snapshot 1b60407c-c4e9-41fc-8fd9-46de61020d95 of volume 2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:19:43 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] snapshot_file for this snap is: volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:19:43 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ca1945-0479-4eb8-be6c-eb98ab2a3857]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95" returned: 0 in 0.370s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:43 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:19:43 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb19ef4-a973-42fd-9e68-e17dccebbe50]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27" returned: 0 in 0.410s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:44 devstack quobyte-client[84147]: System call of process 97587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:19:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95" returned: 0 in 0.262s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27.1b60407c-c4e9-41fc-8fd9-46de61020d95" returned: 0 in 0.084s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Lock "cinder-quobyte-1b60407c-c4e9-41fc-8fd9-46de61020d95" released by "_delete_snapshot" :: held 1.415s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:19:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Lock "cinder-quobyte-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27" released by "delete_snapshot" :: held 1.441s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:19:44 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Created reservations ['7c0432dd-8bc4-4534-94f2-07cbb8087986', '43f1c0a8-4fa9-4b67-a933-fef7dfe6e71f', 'f93223a6-ba3c-45d3-b037-15129eda43d2', '2197803a-d841-4f27-b255-8bcf189ce01c'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:19:44 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Delete snapshot completed successfully.
Sep 18 01:19:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-9cd0195a-1b50-421b-b619-2fc2a2f12493 tempest-VolumesExtendTest-117464597 None] Lock "cinder-1b60407c-c4e9-41fc-8fd9-46de61020d95-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:19:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Acquiring lock "cinder-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:19:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Lock "cinder-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:19:45 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Acquiring lock "cinder-quobyte-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:19:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Lock "cinder-quobyte-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27" acquired by "delete_volume" :: waited 0.010s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:19:45 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5b0fee-c0c9-4087-b66a-09fcf18f29f2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27" returned: 0 in 0.433s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27" returned: 0 in 0.105s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Lock "cinder-quobyte-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27" released by "delete_volume" :: held 0.727s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:19:46 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Created reservations ['2a18a05f-b001-4d45-b969-fb0dca3a5580', 'c597f36d-3775-42fe-b66d-7c71f11f62df', '8aacb652-c7df-4f3a-be25-c6122811feeb', '51969e4d-4bb0-42c8-94c7-881f343ef32c'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:19:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:19:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:19:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.106s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:46 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:19:46 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Deleted volume successfully.
Sep 18 01:19:46 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1f26f7ac-dc39-4cb3-a61d-e4b8a214ede9 tempest-VolumesExtendTest-117464597 None] Lock "cinder-2e93348c-e67b-4e0a-95ce-ad2f2cb33c27-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:19:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2200eea2-f129-4012-a705-1cc47087b78d req-6a6cca4a-6b6e-4a82-809c-e1c1ea5f4fb3 tempest-TestShelveInstance-1967069160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2200eea2-f129-4012-a705-1cc47087b78d req-6a6cca4a-6b6e-4a82-809c-e1c1ea5f4fb3 tempest-TestShelveInstance-1967069160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:49 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f2a720-1d8e-4c49-ab0a-385d2293dc54]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:19:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2200eea2-f129-4012-a705-1cc47087b78d req-6a6cca4a-6b6e-4a82-809c-e1c1ea5f4fb3 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2200eea2-f129-4012-a705-1cc47087b78d req-6a6cca4a-6b6e-4a82-809c-e1c1ea5f4fb3 tempest-TestShelveInstance-1967069160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1" returned: 0 in 0.601s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2200eea2-f129-4012-a705-1cc47087b78d req-6a6cca4a-6b6e-4a82-809c-e1c1ea5f4fb3 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2200eea2-f129-4012-a705-1cc47087b78d req-6a6cca4a-6b6e-4a82-809c-e1c1ea5f4fb3 tempest-TestShelveInstance-1967069160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1" returned: 1 in 0.723s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-2200eea2-f129-4012-a705-1cc47087b78d req-6a6cca4a-6b6e-4a82-809c-e1c1ea5f4fb3 tempest-TestShelveInstance-1967069160 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:19:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-2200eea2-f129-4012-a705-1cc47087b78d req-6a6cca4a-6b6e-4a82-809c-e1c1ea5f4fb3 tempest-TestShelveInstance-1967069160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.461s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-2200eea2-f129-4012-a705-1cc47087b78d req-6a6cca4a-6b6e-4a82-809c-e1c1ea5f4fb3 tempest-TestShelveInstance-1967069160 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28138748-2a76-4663-9052-334ac90d0a2d', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:19:51 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-2200eea2-f129-4012-a705-1cc47087b78d req-6a6cca4a-6b6e-4a82-809c-e1c1ea5f4fb3 tempest-TestShelveInstance-1967069160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:51 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-2200eea2-f129-4012-a705-1cc47087b78d req-6a6cca4a-6b6e-4a82-809c-e1c1ea5f4fb3 tempest-TestShelveInstance-1967069160 None] attachment_update completed successfully.
Sep 18 01:19:54 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Flow 'volume_create_manager' (df8ebfdc-3ffe-4d12-8142-a5137d113ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2987e29-e382-43ce-b4be-62dac4c18bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2987e29-e382-43ce-b4be-62dac4c18bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-576788262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2329c875-5708-4049-aa84-c8263668bc1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af7045c2726f47b09407e8bd63a1faba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:19:54Z,use_quota=True,user_id='42024ac9472a49f3ab4b31779a5e5ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4e2f5c-75a7-4ac8-89a9-f17da191688a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4e2f5c-75a7-4ac8-89a9-f17da191688a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3ad2c5-8fc3-4498-b87d-aed94376bb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3ad2c5-8fc3-4498-b87d-aed94376bb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2329c875-5708-4049-aa84-c8263668bc1d', 'volume_name': 'volume-2329c875-5708-4049-aa84-c8263668bc1d', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfe77fe-a11b-412f-ac80-fea72301dd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfe77fe-a11b-412f-ac80-fea72301dd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8189ba5f-ac75-4f2a-be51-85800b940909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:54 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Volume 2329c875-5708-4049-aa84-c8263668bc1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2329c875-5708-4049-aa84-c8263668bc1d', 'volume_size': 1}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-576788262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2329c875-5708-4049-aa84-c8263668bc1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af7045c2726f47b09407e8bd63a1faba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:19:54Z,use_quota=True,user_id='42024ac9472a49f3ab4b31779a5e5ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Creating volume 2329c875-5708-4049-aa84-c8263668bc1d {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:19:54 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2329c875-5708-4049-aa84-c8263668bc1d 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:54 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=118, name=volume-2329c875-5708-4049-aa84-c8263668bc1d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:19:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2329c875-5708-4049-aa84-c8263668bc1d 1073741824" returned: 0 in 0.511s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2329c875-5708-4049-aa84-c8263668bc1d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2329c875-5708-4049-aa84-c8263668bc1d" returned: 0 in 0.201s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] <== create_volume: return (770ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:19:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8189ba5f-ac75-4f2a-be51-85800b940909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2329c875-5708-4049-aa84-c8263668bc1d', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4855ed-19fe-4ba1-8036-b9b585671f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:55 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Volume volume-2329c875-5708-4049-aa84-c8263668bc1d (2329c875-5708-4049-aa84-c8263668bc1d): created successfully
Sep 18 01:19:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4855ed-19fe-4ba1-8036-b9b585671f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Flow 'volume_create_manager' (df8ebfdc-3ffe-4d12-8142-a5137d113ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:19:55 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-08d9bd5d-6af5-4c36-b556-424ed15db456 tempest-VolumesListTestJSON-1384292436 None] Created volume successfully.
Sep 18 01:19:56 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Flow 'volume_create_manager' (315f2d51-fdac-471b-af53-3432d13a0c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468d42b4-aa69-4df3-933b-c56499829bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468d42b4-aa69-4df3-933b-c56499829bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-827625714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780f9254-aacb-4087-8c69-9573c5e07c2b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af7045c2726f47b09407e8bd63a1faba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:19:57Z,use_quota=True,user_id='42024ac9472a49f3ab4b31779a5e5ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5beb48-6f3c-4b2c-9120-e5b0ba774b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5beb48-6f3c-4b2c-9120-e5b0ba774b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb7b728-01d6-41a1-8909-bab9c7a48a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb7b728-01d6-41a1-8909-bab9c7a48a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '780f9254-aacb-4087-8c69-9573c5e07c2b', 'volume_name': 'volume-780f9254-aacb-4087-8c69-9573c5e07c2b', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8be0d3a-9480-47ca-b1c0-95811301aece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8be0d3a-9480-47ca-b1c0-95811301aece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c35955-3d20-4894-978c-3cd599f37eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:56 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Volume 780f9254-aacb-4087-8c69-9573c5e07c2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-780f9254-aacb-4087-8c69-9573c5e07c2b', 'volume_size': 1}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-827625714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780f9254-aacb-4087-8c69-9573c5e07c2b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af7045c2726f47b09407e8bd63a1faba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:19:57Z,use_quota=True,user_id='42024ac9472a49f3ab4b31779a5e5ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Creating volume 780f9254-aacb-4087-8c69-9573c5e07c2b {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:19:56 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:19:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-780f9254-aacb-4087-8c69-9573c5e07c2b 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:57 devstack quobyte-client[84147]: System call of process 97686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:19:57 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=119, name=volume-780f9254-aacb-4087-8c69-9573c5e07c2b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:19:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-780f9254-aacb-4087-8c69-9573c5e07c2b 1073741824" returned: 0 in 0.360s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-780f9254-aacb-4087-8c69-9573c5e07c2b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-780f9254-aacb-4087-8c69-9573c5e07c2b" returned: 0 in 0.081s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] <== create_volume: return (520ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:19:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.532s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:19:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:19:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:19:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:57 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c35955-3d20-4894-978c-3cd599f37eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-780f9254-aacb-4087-8c69-9573c5e07c2b', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4a8604-4925-4882-a2bd-3b1005dd2344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.414s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:19:58 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:19:58 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Volume volume-780f9254-aacb-4087-8c69-9573c5e07c2b (780f9254-aacb-4087-8c69-9573c5e07c2b): created successfully
Sep 18 01:19:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4a8604-4925-4882-a2bd-3b1005dd2344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Flow 'volume_create_manager' (315f2d51-fdac-471b-af53-3432d13a0c06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:19:58 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3f27030b-86c1-4a06-97d2-56e795a932a4 tempest-VolumesListTestJSON-1384292436 None] Created volume successfully.
Sep 18 01:19:59 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Flow 'volume_create_manager' (23b7057f-6d39-4287-8bd4-84c10dc18588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf269f2c-f7bf-4b4d-bc87-3c1eb60568f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf269f2c-f7bf-4b4d-bc87-3c1eb60568f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-543694684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360c3232-fbee-40db-a043-a43f59b29284,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af7045c2726f47b09407e8bd63a1faba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:19:59Z,use_quota=True,user_id='42024ac9472a49f3ab4b31779a5e5ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd1ba04-22d4-44ff-abc0-4a8fef7183fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd1ba04-22d4-44ff-abc0-4a8fef7183fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c90a415-b505-4d1e-8505-d0c2175c5072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c90a415-b505-4d1e-8505-d0c2175c5072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360c3232-fbee-40db-a043-a43f59b29284', 'volume_name': 'volume-360c3232-fbee-40db-a043-a43f59b29284', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cacce8ba-bcd1-4bba-8e20-096462a7378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cacce8ba-bcd1-4bba-8e20-096462a7378f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9bb9a6-8c9e-4c44-81b9-256bde7f58fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:19:59 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Volume 360c3232-fbee-40db-a043-a43f59b29284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360c3232-fbee-40db-a043-a43f59b29284', 'volume_size': 1}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-543694684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360c3232-fbee-40db-a043-a43f59b29284,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af7045c2726f47b09407e8bd63a1faba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:19:59Z,use_quota=True,user_id='42024ac9472a49f3ab4b31779a5e5ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Creating volume 360c3232-fbee-40db-a043-a43f59b29284 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:19:59 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:19:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-360c3232-fbee-40db-a043-a43f59b29284 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:19:59 devstack quobyte-client[84147]: System call of process 98014 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:19:59 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=120, name=volume-360c3232-fbee-40db-a043-a43f59b29284, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:20:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-360c3232-fbee-40db-a043-a43f59b29284 1073741824" returned: 0 in 0.445s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:20:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-360c3232-fbee-40db-a043-a43f59b29284 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:20:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-360c3232-fbee-40db-a043-a43f59b29284" returned: 0 in 0.091s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:20:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] <== create_volume: return (615ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:20:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.630s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:20:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9bb9a6-8c9e-4c44-81b9-256bde7f58fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360c3232-fbee-40db-a043-a43f59b29284', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:20:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c4d20b-043e-4d89-92ff-4bca28927e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:20:00 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Volume volume-360c3232-fbee-40db-a043-a43f59b29284 (360c3232-fbee-40db-a043-a43f59b29284): created successfully
Sep 18 01:20:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c4d20b-043e-4d89-92ff-4bca28927e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:20:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Flow 'volume_create_manager' (23b7057f-6d39-4287-8bd4-84c10dc18588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:20:00 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-84cab4a7-b852-441f-96d4-40dde40ccc0c tempest-VolumesListTestJSON-1384292436 None] Created volume successfully.
Sep 18 01:20:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "cinder-360c3232-fbee-40db-a043-a43f59b29284-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:20:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Lock "cinder-360c3232-fbee-40db-a043-a43f59b29284-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:20:07 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:20:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "cinder-quobyte-360c3232-fbee-40db-a043-a43f59b29284" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:20:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Lock "cinder-quobyte-360c3232-fbee-40db-a043-a43f59b29284" acquired by "delete_volume" :: waited 0.013s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:20:07 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c594e6e-b966-4fc5-bfe9-7a8fae70efef]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:20:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-360c3232-fbee-40db-a043-a43f59b29284 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:20:07 devstack quobyte-client[84147]: System call of process 98086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:20:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-360c3232-fbee-40db-a043-a43f59b29284" returned: 0 in 0.504s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:20:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-360c3232-fbee-40db-a043-a43f59b29284 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:20:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-360c3232-fbee-40db-a043-a43f59b29284" returned: 0 in 0.103s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:20:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Lock "cinder-quobyte-360c3232-fbee-40db-a043-a43f59b29284" released by "delete_volume" :: held 0.760s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:20:09 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Created reservations ['22b14f04-0a59-425d-ac6c-7e61d1d54e2b', '681d3852-4f5c-4536-8c46-b78f2679375f', '1710e90f-5aa0-4334-ab55-269d20eea8f1', '18a40c6e-b70c-49bf-996c-cf003ff96637'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:20:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:20:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:20:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:20:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:20:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:20:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:20:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.126s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:20:09 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:20:09 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Deleted volume successfully.
Sep 18 01:20:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "cinder-780f9254-aacb-4087-8c69-9573c5e07c2b-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:20:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Lock "cinder-780f9254-aacb-4087-8c69-9573c5e07c2b-delete_volume" acquired by "delete_volume" :: waited 0.167s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:20:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fd4148e6-4565-4cca-9979-a452e760ee0f tempest-VolumesListTestJSON-1384292436 None] Lock "cinder-360c3232-fbee-40db-a043-a43f59b29284-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:20:10 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:20:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "cinder-quobyte-780f9254-aacb-4087-8c69-9573c5e07c2b" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:20:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Lock "cinder-quobyte-780f9254-aacb-4087-8c69-9573c5e07c2b" acquired by "delete_volume" :: waited 0.015s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:20:10 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9d0f7e-4716-4e3b-89e0-d6e8ff610f7c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:20:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-780f9254-aacb-4087-8c69-9573c5e07c2b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:20:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-780f9254-aacb-4087-8c69-9573c5e07c2b" returned: 0 in 0.643s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:20:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-780f9254-aacb-4087-8c69-9573c5e07c2b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:20:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-780f9254-aacb-4087-8c69-9573c5e07c2b" returned: 0 in 0.170s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:20:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Lock "cinder-quobyte-780f9254-aacb-4087-8c69-9573c5e07c2b" released by "delete_volume" :: held 1.013s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:20:12 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Created reservations ['53bd6b0e-ad8e-4804-a3c4-e2c4b4de3442', 'e0dc0576-4c4d-45fc-b333-d7d2a1624c3e', 'd7c2edec-e53a-4310-8dd8-2bf0d932c330', '9e484963-1875-4ff5-8c41-21ac3aa4c69d'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:20:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:20:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:20:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:20:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:20:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:20:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:20:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.162s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:20:12 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:20:13 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Deleted volume successfully.
Sep 18 01:20:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f8a04f8f-2b36-40b4-92a8-47cb485052b8 tempest-VolumesListTestJSON-1384292436 None] Lock "cinder-780f9254-aacb-4087-8c69-9573c5e07c2b-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:20:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "cinder-2329c875-5708-4049-aa84-c8263668bc1d-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:20:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Lock "cinder-2329c875-5708-4049-aa84-c8263668bc1d-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:20:14 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:20:14 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "cinder-quobyte-2329c875-5708-4049-aa84-c8263668bc1d" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:20:14 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Lock "cinder-quobyte-2329c875-5708-4049-aa84-c8263668bc1d" acquired by "delete_volume" :: waited 0.032s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:20:14 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de350bb-c148-4159-a8f2-bfc193730998]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:20:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2329c875-5708-4049-aa84-c8263668bc1d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:20:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2329c875-5708-4049-aa84-c8263668bc1d" returned: 0 in 0.621s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:20:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2329c875-5708-4049-aa84-c8263668bc1d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:20:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2329c875-5708-4049-aa84-c8263668bc1d" returned: 0 in 0.241s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:20:15 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Lock "cinder-quobyte-2329c875-5708-4049-aa84-c8263668bc1d" released by "delete_volume" :: held 1.227s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:20:16 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Created reservations ['061eca4a-019e-4f6d-adc7-90b289e7b1f4', '9be57358-6b64-4d83-b28f-036683288350', '0eb59ca0-4131-4246-9c88-c878621fbeb5', 'a91433db-02a8-43da-a951-5aab9faf6d21'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:20:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:20:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:20:16 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:20:16 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:20:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:20:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:20:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.264s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:20:16 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:20:17 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Deleted volume successfully.
Sep 18 01:20:17 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-f799f704-1a52-4bd4-9e53-3fc670780c91 tempest-VolumesListTestJSON-1384292436 None] Lock "cinder-2329c875-5708-4049-aa84-c8263668bc1d-delete_volume" released by "delete_volume" :: held 3.559s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:20:20 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Flow 'volume_create_manager' (e43a54f0-0903-48d7-af80-c4599691a6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d423805-80ad-4939-a8e5-35e6ec14f02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d423805-80ad-4939-a8e5-35e6ec14f02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-962269781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d046159c39e42f59117e7612da06f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:20:20Z,use_quota=True,user_id='2b7ee2a15caa454fabb2e0f117078612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b3a073-1617-4202-bf13-d60e9752d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b3a073-1617-4202-bf13-d60e9752d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166d0e00-5524-4c4e-8a4f-eff9013af013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166d0e00-5524-4c4e-8a4f-eff9013af013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82', 'volume_name': 'volume-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (691544f5-b73a-4732-91fe-d8a279e79057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (691544f5-b73a-4732-91fe-d8a279e79057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30192c8-9023-4e03-b4de-c48068348f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:20:20 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Volume 9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82', 'volume_size': 1}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-962269781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d046159c39e42f59117e7612da06f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:20:20Z,use_quota=True,user_id='2b7ee2a15caa454fabb2e0f117078612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Creating volume 9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:20:20 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:20:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:20:20 devstack quobyte-client[84147]: System call of process 98162 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:20:20 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=121, name=volume-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:20:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82 1073741824" returned: 0 in 0.459s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:20:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:20:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82" returned: 0 in 0.182s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:20:21 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] <== create_volume: return (713ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:20:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:20:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30192c8-9023-4e03-b4de-c48068348f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:20:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de867a20-7414-4f8d-8ca4-cc1d7d4966c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:20:21 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Volume volume-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82 (9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82): created successfully
Sep 18 01:20:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de867a20-7414-4f8d-8ca4-cc1d7d4966c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:20:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Flow 'volume_create_manager' (e43a54f0-0903-48d7-af80-c4599691a6de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:20:21 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-dcf327e5-f43d-42f9-9312-505698906895 tempest-VolumesNegativeTest-290313567 None] Created volume successfully.
Sep 18 01:20:31 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=60,cinder:UPDATE=55,cinder:INSERT=22,cinder:DELETE=4 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:20:31 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=40,cinder:UPDATE=77,cinder:DELETE=8,cinder:INSERT=14 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:20:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:20:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:20:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:20:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:20:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:20:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:20:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:20:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.133s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:20:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:21:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Acquiring lock "cinder-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:21:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Lock "cinder-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:21:02 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:21:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Acquiring lock "cinder-quobyte-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:21:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Lock "cinder-quobyte-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82" acquired by "delete_volume" :: waited 0.022s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:21:02 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[823aa5be-2076-42d7-8ac6-6b60afe3ae99]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:21:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82" returned: 0 in 0.767s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82" returned: 0 in 0.105s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Lock "cinder-quobyte-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82" released by "delete_volume" :: held 1.099s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:21:03 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Created reservations ['460db40f-859d-4ebd-ad90-93421e89a712', '142b96ea-b000-456e-9849-d04d78218720', '55ccce2e-7329-4cbb-82fb-59f821c0b108', '54657cb1-bf4f-403f-9ab0-bcdaae6c3ebb'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:21:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:21:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:21:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:21:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:21:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:21:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.091s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:04 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:21:04 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Deleted volume successfully.
Sep 18 01:21:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b739eca1-0dc2-4842-879d-8b3b5dc944af tempest-VolumesNegativeTest-290313567 None] Lock "cinder-9f9d6bea-8f48-4f08-b36e-b2e2b6c78d82-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:21:14 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=7,cinder:UPDATE=16,cinder:INSERT=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:21:14 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:21:26 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:21:28 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-7c9e3935-3c81-480a-8878-354df3b3d2b5 req-4fad2bf2-cdcb-4c9b-bed1-393506b14459 tempest-TestShelveInstance-1967069160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:21:28 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-7c9e3935-3c81-480a-8878-354df3b3d2b5 req-4fad2bf2-cdcb-4c9b-bed1-393506b14459 tempest-TestShelveInstance-1967069160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:21:28 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-7c9e3935-3c81-480a-8878-354df3b3d2b5 req-4fad2bf2-cdcb-4c9b-bed1-393506b14459 tempest-TestShelveInstance-1967069160 None] Terminate volume connection completed successfully.
Sep 18 01:21:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-7c9e3935-3c81-480a-8878-354df3b3d2b5 req-4fad2bf2-cdcb-4c9b-bed1-393506b14459 tempest-TestShelveInstance-1967069160 None] Deleting attachment 28138748-2a76-4663-9052-334ac90d0a2d. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:21:31 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Flow 'volume_create_manager' (18c8e78e-b1a6-4f4d-bc3a-446fe3e9ad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc402f70-5b3d-48b7-a9af-006a224c5d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc402f70-5b3d-48b7-a9af-006a224c5d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1451042678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39445fae-c85f-46b4-969c-f037ef2b66bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09b3726db784da18feb8998a70fa5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:21:31Z,use_quota=True,user_id='fb28872e20ee4bc5bc71dc5851a2c8dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf43b01-ba2c-48f8-bb2e-1fe2195dcb9a),volume_type_id=cdf43b01-ba2c-48f8-bb2e-1fe2195dcb9a)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01835250-d2af-4348-9d7d-0cb854a7bb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01835250-d2af-4348-9d7d-0cb854a7bb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91506913-dd86-4443-aecd-6ae3d19ede1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91506913-dd86-4443-aecd-6ae3d19ede1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39445fae-c85f-46b4-969c-f037ef2b66bd', 'volume_name': 'volume-39445fae-c85f-46b4-969c-f037ef2b66bd', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202e0469-61bd-47b1-9693-18b1fb665934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202e0469-61bd-47b1-9693-18b1fb665934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06e0aba-7ba0-471c-b9a9-3eca00f59f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:31 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Volume 39445fae-c85f-46b4-969c-f037ef2b66bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39445fae-c85f-46b4-969c-f037ef2b66bd', 'volume_size': 1}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1451042678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39445fae-c85f-46b4-969c-f037ef2b66bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09b3726db784da18feb8998a70fa5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:21:31Z,use_quota=True,user_id='fb28872e20ee4bc5bc71dc5851a2c8dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdf43b01-ba2c-48f8-bb2e-1fe2195dcb9a),volume_type_id=cdf43b01-ba2c-48f8-bb2e-1fe2195dcb9a)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Creating volume 39445fae-c85f-46b4-969c-f037ef2b66bd {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:21:31 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:21:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-39445fae-c85f-46b4-969c-f037ef2b66bd 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:31 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=122, name=volume-39445fae-c85f-46b4-969c-f037ef2b66bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-39445fae-c85f-46b4-969c-f037ef2b66bd 1073741824" returned: 0 in 0.819s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-39445fae-c85f-46b4-969c-f037ef2b66bd {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:32 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Flow 'volume_create_manager' (acb14e1b-8543-46b0-a550-ac9f61d3280e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957997f5-19e2-4d47-ae60-43a7d5a51f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-39445fae-c85f-46b4-969c-f037ef2b66bd" returned: 0 in 0.596s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] <== create_volume: return (1474ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957997f5-19e2-4d47-ae60-43a7d5a51f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-219766626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadb6961-7921-49f6-9552-c81d1ce20d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09b3726db784da18feb8998a70fa5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:21:32Z,use_quota=True,user_id='fb28872e20ee4bc5bc71dc5851a2c8dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13a805b0-8d03-48d6-810c-14cc8d20405a),volume_type_id=13a805b0-8d03-48d6-810c-14cc8d20405a)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcde9fdb-4316-4a9f-800c-b220155564f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcde9fdb-4316-4a9f-800c-b220155564f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830ca5ed-6e36-4641-a841-c90dcaf261b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830ca5ed-6e36-4641-a841-c90dcaf261b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dadb6961-7921-49f6-9552-c81d1ce20d61', 'volume_name': 'volume-dadb6961-7921-49f6-9552-c81d1ce20d61', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d26f099-7e20-412c-83c5-b1acf16d5c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d26f099-7e20-412c-83c5-b1acf16d5c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8403d7b2-66d5-489c-9480-1f95e690901a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:32 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Volume dadb6961-7921-49f6-9552-c81d1ce20d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dadb6961-7921-49f6-9552-c81d1ce20d61', 'volume_size': 1}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-219766626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadb6961-7921-49f6-9552-c81d1ce20d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09b3726db784da18feb8998a70fa5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:21:32Z,use_quota=True,user_id='fb28872e20ee4bc5bc71dc5851a2c8dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13a805b0-8d03-48d6-810c-14cc8d20405a),volume_type_id=13a805b0-8d03-48d6-810c-14cc8d20405a)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Creating volume dadb6961-7921-49f6-9552-c81d1ce20d61 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:21:32 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:21:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-dadb6961-7921-49f6-9552-c81d1ce20d61 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:32 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=123, name=volume-dadb6961-7921-49f6-9552-c81d1ce20d61, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:21:33 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:21:33 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:21:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Flow 'volume_create_manager' (061c22de-f8c4-4333-9ecc-3ed6bf7ec2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:21:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c40bb1-59ef-4aeb-96b9-522c8f9ac991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c40bb1-59ef-4aeb-96b9-522c8f9ac991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1104119750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d871cd3-3e0b-4e80-ac15-83ce69454883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09b3726db784da18feb8998a70fa5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:21:32Z,use_quota=True,user_id='fb28872e20ee4bc5bc71dc5851a2c8dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3aeb49ad-c578-4b96-b000-a65b0aff9d6e),volume_type_id=3aeb49ad-c578-4b96-b000-a65b0aff9d6e)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159d1903-129f-4aa1-963f-055e26934f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159d1903-129f-4aa1-963f-055e26934f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a743940e-c5cd-44b3-bb06-cf23b926f49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:33 devstack cinder-volume[84134]: DEBUG cinder.image.glance [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Creating Keystone auth plugin from conf {{(pid=84134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 01:21:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06e0aba-7ba0-471c-b9a9-3eca00f59f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39445fae-c85f-46b4-969c-f037ef2b66bd', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412e213e-8213-4429-aa84-1b32c45161bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-dadb6961-7921-49f6-9552-c81d1ce20d61 1073741824" returned: 0 in 0.712s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-dadb6961-7921-49f6-9552-c81d1ce20d61 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:33 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Volume volume-39445fae-c85f-46b4-969c-f037ef2b66bd (39445fae-c85f-46b4-969c-f037ef2b66bd): created successfully
Sep 18 01:21:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412e213e-8213-4429-aa84-1b32c45161bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Flow 'volume_create_manager' (18c8e78e-b1a6-4f4d-bc3a-446fe3e9ad55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:21:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-dadb6961-7921-49f6-9552-c81d1ce20d61" returned: 0 in 0.495s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] <== create_volume: return (1224ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:21:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:21:34 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-fc03e078-6c6b-4295-9df9-52c17b8ce6e0 tempest-TestInstancesWithCinderVolumes-302585926 None] Created volume successfully.
Sep 18 01:21:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8403d7b2-66d5-489c-9480-1f95e690901a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dadb6961-7921-49f6-9552-c81d1ce20d61', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fbd967-a756-47b7-91c4-e31528047c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:34 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Volume volume-dadb6961-7921-49f6-9552-c81d1ce20d61 (dadb6961-7921-49f6-9552-c81d1ce20d61): created successfully
Sep 18 01:21:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fbd967-a756-47b7-91c4-e31528047c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Flow 'volume_create_manager' (acb14e1b-8543-46b0-a550-ac9f61d3280e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:21:34 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3a07f2e9-cb09-4904-bbd5-704aeb8be59f tempest-TestInstancesWithCinderVolumes-302585926 None] Created volume successfully.
Sep 18 01:21:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a743940e-c5cd-44b3-bb06-cf23b926f49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d871cd3-3e0b-4e80-ac15-83ce69454883', 'volume_name': 'volume-4d871cd3-3e0b-4e80-ac15-83ce69454883', 'volume_size': 1, 'image_id': '7719b0db-3e5b-409a-bbe0-1fc00062db62', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7719b0db-3e5b-409a-bbe0-1fc00062db62', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--558248466', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b09b3726db784da18feb8998a70fa5d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7719b0db-3e5b-409a-bbe0-1fc00062db62', 'created_at': datetime.datetime(2025, 9, 17, 23, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 23, 21, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7719b0db-3e5b-409a-bbe0-1fc00062db62/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a69db040>}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d980f26a-6ade-4897-9ac4-0a350ca0dbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d980f26a-6ade-4897-9ac4-0a350ca0dbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7ca3ad-6c56-4c3e-ab65-66599082201e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:34 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Volume 4d871cd3-3e0b-4e80-ac15-83ce69454883: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d871cd3-3e0b-4e80-ac15-83ce69454883', 'volume_size': 1, 'image_id': '7719b0db-3e5b-409a-bbe0-1fc00062db62', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7719b0db-3e5b-409a-bbe0-1fc00062db62', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--558248466', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b09b3726db784da18feb8998a70fa5d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7719b0db-3e5b-409a-bbe0-1fc00062db62', 'created_at': datetime.datetime(2025, 9, 17, 23, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 23, 21, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7719b0db-3e5b-409a-bbe0-1fc00062db62/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a69db040>}
Sep 18 01:21:34 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Cloning 4d871cd3-3e0b-4e80-ac15-83ce69454883 from image 7719b0db-3e5b-409a-bbe0-1fc00062db62  at location (None, [{'url': 'file:///opt/stack/data/glance/images/7719b0db-3e5b-409a-bbe0-1fc00062db62', 'metadata': {}}]). {{(pid=84134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 01:21:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-ab64c6ba-6032-42b2-8db3-4a611ced549d req-6a347138-eb9e-4c4b-81b9-02019b968b65 tempest-TestShelveInstance-1967069160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:21:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-ab64c6ba-6032-42b2-8db3-4a611ced549d req-6a347138-eb9e-4c4b-81b9-02019b968b65 tempest-TestShelveInstance-1967069160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:21:35 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f120b1-3397-4d74-bcb3-e35b610168ab]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:21:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ab64c6ba-6032-42b2-8db3-4a611ced549d req-6a347138-eb9e-4c4b-81b9-02019b968b65 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ab64c6ba-6032-42b2-8db3-4a611ced549d req-6a347138-eb9e-4c4b-81b9-02019b968b65 tempest-TestShelveInstance-1967069160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1" returned: 0 in 0.423s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ab64c6ba-6032-42b2-8db3-4a611ced549d req-6a347138-eb9e-4c4b-81b9-02019b968b65 tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ab64c6ba-6032-42b2-8db3-4a611ced549d req-6a347138-eb9e-4c4b-81b9-02019b968b65 tempest-TestShelveInstance-1967069160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1" returned: 1 in 0.425s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-ab64c6ba-6032-42b2-8db3-4a611ced549d req-6a347138-eb9e-4c4b-81b9-02019b968b65 tempest-TestShelveInstance-1967069160 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:21:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-ab64c6ba-6032-42b2-8db3-4a611ced549d req-6a347138-eb9e-4c4b-81b9-02019b968b65 tempest-TestShelveInstance-1967069160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.986s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:21:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-ab64c6ba-6032-42b2-8db3-4a611ced549d req-6a347138-eb9e-4c4b-81b9-02019b968b65 tempest-TestShelveInstance-1967069160 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '325c303c-923b-4353-ac20-f615e3c12e12', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:21:37 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-ab64c6ba-6032-42b2-8db3-4a611ced549d req-6a347138-eb9e-4c4b-81b9-02019b968b65 tempest-TestShelveInstance-1967069160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:21:37 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7719b0db-3e5b-409a-bbe0-1fc00062db62_0rxn_fcsdevstack@QuobyteHD, size 20.69 MB, duration 2.59 sec {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 01:21:37 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Image download 20.69 MB at 7.98 MB/s
Sep 18 01:21:37 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[23296dbc-a763-4be8-9362-1e04bc07c9c2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:21:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7719b0db-3e5b-409a-bbe0-1fc00062db62_0rxn_fcsdevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:37 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-ab64c6ba-6032-42b2-8db3-4a611ced549d req-6a347138-eb9e-4c4b-81b9-02019b968b65 tempest-TestShelveInstance-1967069160 None] attachment_update completed successfully.
Sep 18 01:21:37 devstack sudo[98471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7719b0db-3e5b-409a-bbe0-1fc00062db62_0rxn_fcsdevstack@QuobyteHD
Sep 18 01:21:37 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:21:39 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root
Sep 18 01:21:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7719b0db-3e5b-409a-bbe0-1fc00062db62_0rxn_fcsdevstack@QuobyteHD" returned: 0 in 2.247s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:39 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Temporary image 7719b0db-3e5b-409a-bbe0-1fc00062db62 is fetched for user fb28872e20ee4bc5bc71dc5851a2c8dd. {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 01:21:39 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8718f040-f977-4362-b0e3-3b9ea88b57cd]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:21:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7719b0db-3e5b-409a-bbe0-1fc00062db62_0rxn_fcsdevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:40 devstack sudo[98476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7719b0db-3e5b-409a-bbe0-1fc00062db62_0rxn_fcsdevstack@QuobyteHD
Sep 18 01:21:40 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:21:41 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root
Sep 18 01:21:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7719b0db-3e5b-409a-bbe0-1fc00062db62_0rxn_fcsdevstack@QuobyteHD" returned: 0 in 2.008s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:21:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:21:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1104119750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d871cd3-3e0b-4e80-ac15-83ce69454883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09b3726db784da18feb8998a70fa5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:21:32Z,use_quota=True,user_id='fb28872e20ee4bc5bc71dc5851a2c8dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3aeb49ad-c578-4b96-b000-a65b0aff9d6e),volume_type_id=3aeb49ad-c578-4b96-b000-a65b0aff9d6e)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:21:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Creating volume 4d871cd3-3e0b-4e80-ac15-83ce69454883 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:21:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:21:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:21:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:21:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:21:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:21:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:21:41 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:21:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:41 devstack quobyte-client[84147]: System call of process 98481 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:21:41 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=124, name=volume-4d871cd3-3e0b-4e80-ac15-83ce69454883, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:21:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 1073741824" returned: 0 in 0.347s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883" returned: 0 in 0.087s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] <== create_volume: return (534ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:21:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.568s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:21:42 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Attempting download of 7719b0db-3e5b-409a-bbe0-1fc00062db62 ((None, [{'url': 'file:///opt/stack/data/glance/images/7719b0db-3e5b-409a-bbe0-1fc00062db62', 'metadata': {}}])) to volume 4d871cd3-3e0b-4e80-ac15-83ce69454883. {{(pid=84134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 01:21:42 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[731a1424-4e6a-417b-a9b2-38fb4b935646]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:21:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7719b0db-3e5b-409a-bbe0-1fc00062db62_vxwz14gm {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7719b0db-3e5b-409a-bbe0-1fc00062db62_vxwz14gm" returned: 0 in 0.436s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7719b0db-3e5b-409a-bbe0-1fc00062db62_vxwz14gm {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7719b0db-3e5b-409a-bbe0-1fc00062db62_vxwz14gm" returned: 1 in 0.447s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7719b0db-3e5b-409a-bbe0-1fc00062db62_vxwz14gm' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:21:43 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[99421253-3f73-4f8c-b969-cc36003e79e2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:21:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7719b0db-3e5b-409a-bbe0-1fc00062db62_0rxn_fcsdevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7719b0db-3e5b-409a-bbe0-1fc00062db62_0rxn_fcsdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:44 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] 7719b0db-3e5b-409a-bbe0-1fc00062db62 was qcow2, converting to raw {{(pid=84134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 01:21:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7719b0db-3e5b-409a-bbe0-1fc00062db62_0rxn_fcsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:44 devstack quobyte-client[84147]: System call of process 98495 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:21:44 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=124, name=volume-4d871cd3-3e0b-4e80-ac15-83ce69454883, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:21:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7719b0db-3e5b-409a-bbe0-1fc00062db62_0rxn_fcsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883" returned: 0 in 1.089s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:45 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7719b0db-3e5b-409a-bbe0-1fc00062db62_0rxn_fcsdevstack@QuobyteHD, size 112.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 {{(pid=84134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 01:21:45 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Converted 112.00 MB image at 100.04 MB/s
Sep 18 01:21:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 1G" returned: 0 in 0.127s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:45 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a2f4b9-9bb9-48e6-a17d-2fc2d443f3a3]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:21:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883" returned: 0 in 0.462s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883" returned: 1 in 0.543s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:21:46 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Downloaded image 7719b0db-3e5b-409a-bbe0-1fc00062db62 ((None, [{'url': 'file:///opt/stack/data/glance/images/7719b0db-3e5b-409a-bbe0-1fc00062db62', 'metadata': {}}])) to volume 4d871cd3-3e0b-4e80-ac15-83ce69454883 successfully. {{(pid=84134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 01:21:46 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Temporary image 7719b0db-3e5b-409a-bbe0-1fc00062db62 for user fb28872e20ee4bc5bc71dc5851a2c8dd is deleted. {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 01:21:46 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Marking volume 4d871cd3-3e0b-4e80-ac15-83ce69454883 as bootable. {{(pid=84134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 01:21:46 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Copying metadata from image 7719b0db-3e5b-409a-bbe0-1fc00062db62 to 4d871cd3-3e0b-4e80-ac15-83ce69454883. {{(pid=84134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 01:21:46 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Creating volume glance metadata for volume 4d871cd3-3e0b-4e80-ac15-83ce69454883 backed by image 7719b0db-3e5b-409a-bbe0-1fc00062db62 with: {'image_id': '7719b0db-3e5b-409a-bbe0-1fc00062db62', 'image_name': 'tempest-scenario-img--558248466', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 01:21:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7ca3ad-6c56-4c3e-ab65-66599082201e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d871cd3-3e0b-4e80-ac15-83ce69454883', 'volume_size': 1, 'image_id': '7719b0db-3e5b-409a-bbe0-1fc00062db62', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7719b0db-3e5b-409a-bbe0-1fc00062db62', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--558248466', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b09b3726db784da18feb8998a70fa5d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7719b0db-3e5b-409a-bbe0-1fc00062db62', 'created_at': datetime.datetime(2025, 9, 17, 23, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 23, 21, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7719b0db-3e5b-409a-bbe0-1fc00062db62/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a69db040>}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25150a0a-d3ed-4faf-bf83-2fa5c515fbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:21:46 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Volume volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 (4d871cd3-3e0b-4e80-ac15-83ce69454883): created successfully
Sep 18 01:21:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25150a0a-d3ed-4faf-bf83-2fa5c515fbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:21:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Flow 'volume_create_manager' (061c22de-f8c4-4333-9ecc-3ed6bf7ec2ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:21:46 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-c0eff4c1-50aa-45a7-9544-02ba1fa13b6b tempest-TestInstancesWithCinderVolumes-302585926 None] Created volume successfully.
Sep 18 01:21:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-8e324645-f73c-4135-8d11-23b3529cfec1 req-4e23a418-2949-4cd8-bf07-573c07b8b2d4 tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:21:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-8e324645-f73c-4135-8d11-23b3529cfec1 req-4e23a418-2949-4cd8-bf07-573c07b8b2d4 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:21:56 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78c2ee2-df17-40f6-9789-ef9b0b0d0c02]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:21:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-8e324645-f73c-4135-8d11-23b3529cfec1 req-4e23a418-2949-4cd8-bf07-573c07b8b2d4 tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-8e324645-f73c-4135-8d11-23b3529cfec1 req-4e23a418-2949-4cd8-bf07-573c07b8b2d4 tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883" returned: 0 in 0.461s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-8e324645-f73c-4135-8d11-23b3529cfec1 req-4e23a418-2949-4cd8-bf07-573c07b8b2d4 tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:21:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:21:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.053s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:21:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:21:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:21:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.065s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:21:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:21:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-8e324645-f73c-4135-8d11-23b3529cfec1 req-4e23a418-2949-4cd8-bf07-573c07b8b2d4 tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883" returned: 1 in 0.809s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-8e324645-f73c-4135-8d11-23b3529cfec1 req-4e23a418-2949-4cd8-bf07-573c07b8b2d4 tempest-TestInstancesWithCinderVolumes-302585926 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:21:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-8e324645-f73c-4135-8d11-23b3529cfec1 req-4e23a418-2949-4cd8-bf07-573c07b8b2d4 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.553s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:21:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.656s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:21:58 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:21:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8e324645-f73c-4135-8d11-23b3529cfec1 req-4e23a418-2949-4cd8-bf07-573c07b8b2d4 tempest-TestInstancesWithCinderVolumes-302585926 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-4d871cd3-3e0b-4e80-ac15-83ce69454883', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df0b1d9e-cb42-4dc7-a6d6-9ee4425d2ee3', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:21:58 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-8e324645-f73c-4135-8d11-23b3529cfec1 req-4e23a418-2949-4cd8-bf07-573c07b8b2d4 tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:21:58 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-8e324645-f73c-4135-8d11-23b3529cfec1 req-4e23a418-2949-4cd8-bf07-573c07b8b2d4 tempest-TestInstancesWithCinderVolumes-302585926 None] attachment_update completed successfully.
Sep 18 01:22:08 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=21,cinder:UPDATE=10,cinder:INSERT=5 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:22:08 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=20,cinder:UPDATE=11,cinder:DELETE=3,cinder:INSERT=4 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:22:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:22:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:22:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:22:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:22:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:22:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:22:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:22:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.085s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:22:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:23:10 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-ac8f016e-5950-49c3-bc8d-06538e2e725f tempest-TestShelveInstance-1967069160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:10 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-ac8f016e-5950-49c3-bc8d-06538e2e725f tempest-TestShelveInstance-1967069160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:10 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-ac8f016e-5950-49c3-bc8d-06538e2e725f tempest-TestShelveInstance-1967069160 None] Terminate volume connection completed successfully.
Sep 18 01:23:10 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-ac8f016e-5950-49c3-bc8d-06538e2e725f tempest-TestShelveInstance-1967069160 None] Deleting attachment 325c303c-923b-4353-ac20-f615e3c12e12. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:23:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Acquiring lock "cinder-c84aca45-16a9-44c8-906e-1327bfa1d9b1-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Lock "cinder-c84aca45-16a9-44c8-906e-1327bfa1d9b1-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:11 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Acquiring lock "cinder-quobyte-c84aca45-16a9-44c8-906e-1327bfa1d9b1" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Lock "cinder-quobyte-c84aca45-16a9-44c8-906e-1327bfa1d9b1" acquired by "delete_volume" :: waited 0.013s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:11 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea2f3d0-bfd7-4791-9ff5-523b52865cb7]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:23:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1" returned: 0 in 0.434s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1" returned: 1 in 0.425s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:23:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c84aca45-16a9-44c8-906e-1327bfa1d9b1" returned: 0 in 0.118s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Lock "cinder-quobyte-c84aca45-16a9-44c8-906e-1327bfa1d9b1" released by "delete_volume" :: held 1.331s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:13 devstack cinder-volume[84134]: DEBUG cinder.quota [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Created reservations ['8c3e720f-e845-471c-bfda-f9128bea009b', '5acecbab-6fca-4e5d-af4c-fb0addf02891', '80b53618-8563-4219-88ae-956aa5943a65', 'c462db81-801f-4989-950b-e7bdcec96cec'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:23:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:23:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:23:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.094s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:13 devstack cinder-volume[84134]: DEBUG cinder.manager [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:23:13 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Deleted volume successfully.
Sep 18 01:23:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [req-87a283bf-c6e4-4a70-bce2-a78202bbef89 req-7b6319c4-0b09-49d3-a8ab-161672596fba tempest-TestShelveInstance-1967069160 None] Lock "cinder-c84aca45-16a9-44c8-906e-1327bfa1d9b1-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-8bdcac10-e9cc-4c7b-b09f-cc26a04d077b req-a0d2ac15-4654-4298-8be3-b6e9a4af6591 tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-8bdcac10-e9cc-4c7b-b09f-cc26a04d077b req-a0d2ac15-4654-4298-8be3-b6e9a4af6591 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:20 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[beba4758-68b9-4c73-94c0-e2066fd1ecc1]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:23:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-8bdcac10-e9cc-4c7b-b09f-cc26a04d077b req-a0d2ac15-4654-4298-8be3-b6e9a4af6591 tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-39445fae-c85f-46b4-969c-f037ef2b66bd {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-8bdcac10-e9cc-4c7b-b09f-cc26a04d077b req-a0d2ac15-4654-4298-8be3-b6e9a4af6591 tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-39445fae-c85f-46b4-969c-f037ef2b66bd" returned: 0 in 0.698s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-8bdcac10-e9cc-4c7b-b09f-cc26a04d077b req-a0d2ac15-4654-4298-8be3-b6e9a4af6591 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.786s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:21 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-8bdcac10-e9cc-4c7b-b09f-cc26a04d077b req-a0d2ac15-4654-4298-8be3-b6e9a4af6591 tempest-TestInstancesWithCinderVolumes-302585926 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-39445fae-c85f-46b4-969c-f037ef2b66bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88c41d1e-d43c-4fa3-8349-5543b2797f2f', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:23:21 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-8bdcac10-e9cc-4c7b-b09f-cc26a04d077b req-a0d2ac15-4654-4298-8be3-b6e9a4af6591 tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:21 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-8bdcac10-e9cc-4c7b-b09f-cc26a04d077b req-a0d2ac15-4654-4298-8be3-b6e9a4af6591 tempest-TestInstancesWithCinderVolumes-302585926 None] attachment_update completed successfully.
Sep 18 01:23:31 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:23:31 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:23:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-79f83cac-16ca-43de-ad1e-09b7cad2be61 req-14d11ef7-e73b-4803-a918-f37c30a0ac8a tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-79f83cac-16ca-43de-ad1e-09b7cad2be61 req-14d11ef7-e73b-4803-a918-f37c30a0ac8a tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:32 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[70381256-9e56-4b41-8c41-789ad2f00712]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:23:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-79f83cac-16ca-43de-ad1e-09b7cad2be61 req-14d11ef7-e73b-4803-a918-f37c30a0ac8a tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-dadb6961-7921-49f6-9552-c81d1ce20d61 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-79f83cac-16ca-43de-ad1e-09b7cad2be61 req-14d11ef7-e73b-4803-a918-f37c30a0ac8a tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-dadb6961-7921-49f6-9552-c81d1ce20d61" returned: 0 in 0.706s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-79f83cac-16ca-43de-ad1e-09b7cad2be61 req-14d11ef7-e73b-4803-a918-f37c30a0ac8a tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.758s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:33 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Flow 'volume_create_manager' (963c8f66-ebb0-437a-86ef-d40efe8d8566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab03f51-6136-4891-a408-a1ad81a4c8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-79f83cac-16ca-43de-ad1e-09b7cad2be61 req-14d11ef7-e73b-4803-a918-f37c30a0ac8a tempest-TestInstancesWithCinderVolumes-302585926 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-dadb6961-7921-49f6-9552-c81d1ce20d61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c63a3d5b-a2bc-445d-b228-f9df5df74453', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:23:33 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-79f83cac-16ca-43de-ad1e-09b7cad2be61 req-14d11ef7-e73b-4803-a918-f37c30a0ac8a tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab03f51-6136-4891-a408-a1ad81a4c8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1152954807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf409eb-d327-4fa3-ba8d-84a39d86d571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce75a66c2d541d7b548544c1fda9744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:23:33Z,use_quota=True,user_id='f31e9d56bc2b435bb9f229e2025649a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd7507a-d845-49cf-86f5-3dfba30c2081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd7507a-d845-49cf-86f5-3dfba30c2081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f72f22-a821-409d-9766-438c0de25c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f72f22-a821-409d-9766-438c0de25c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbf409eb-d327-4fa3-ba8d-84a39d86d571', 'volume_name': 'volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04799f4f-b5e3-4cd8-97b4-259c45ccb53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04799f4f-b5e3-4cd8-97b4-259c45ccb53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d7e7fc-0bc4-42e8-b372-597a1dc5fee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:33 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume bbf409eb-d327-4fa3-ba8d-84a39d86d571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571', 'volume_size': 1}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1152954807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf409eb-d327-4fa3-ba8d-84a39d86d571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce75a66c2d541d7b548544c1fda9744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:23:33Z,use_quota=True,user_id='f31e9d56bc2b435bb9f229e2025649a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Creating volume bbf409eb-d327-4fa3-ba8d-84a39d86d571 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:23:33 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:23:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:33 devstack quobyte-client[84147]: System call of process 99334 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:23:33 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=125, name=volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:23:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571 1073741824" returned: 0 in 0.470s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:34 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-79f83cac-16ca-43de-ad1e-09b7cad2be61 req-14d11ef7-e73b-4803-a918-f37c30a0ac8a tempest-TestInstancesWithCinderVolumes-302585926 None] attachment_update completed successfully.
Sep 18 01:23:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571" returned: 0 in 0.332s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:34 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] <== create_volume: return (836ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:23:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d7e7fc-0bc4-42e8-b372-597a1dc5fee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260bc03a-8bda-40b7-af1f-ef46f395aba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:34 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571 (bbf409eb-d327-4fa3-ba8d-84a39d86d571): created successfully
Sep 18 01:23:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260bc03a-8bda-40b7-af1f-ef46f395aba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Flow 'volume_create_manager' (963c8f66-ebb0-437a-86ef-d40efe8d8566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:23:34 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-04153456-2bb9-48cb-8e7c-ced619717ae9 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Created volume successfully.
Sep 18 01:23:35 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] Creating offline snapshot 234f47b4-18fa-4ae3-abb8-9284abd9a1a8 of volume bbf409eb-d327-4fa3-ba8d-84a39d86d571 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:23:35 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[913dabcf-c71d-41d6-9fd9-d4c8032ae915]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:23:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:36 devstack quobyte-client[84147]: System call of process 99343 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:23:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571" returned: 0 in 0.541s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:36 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=126, name=volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:23:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8 1G" returned: 0 in 0.208s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "qemu-img rebase -u -b volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8" returned: 0 in 0.125s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:36 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:23:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8" returned: 0 in 0.099s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:23:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8" returned: 0 in 0.081s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.info" returned: 0 in 0.090s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:23:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.info" returned: 0 in 0.079s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.551s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:37 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-84db4d2e-2a5e-47f4-84a2-429f25c8b37e tempest-CreateVolumesFromSnapshotTest-1643247051 None] Create snapshot completed successfully
Sep 18 01:23:38 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Flow 'volume_create_manager' (8d9eebdd-20a2-410b-96f8-cece3488d7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57efa969-9520-4988-8e4b-38d56af1a042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57efa969-9520-4988-8e4b-38d56af1a042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-255684624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe00d568-73ae-4caa-9a09-d3df64b10756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce75a66c2d541d7b548544c1fda9744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:23:38Z,use_quota=True,user_id='f31e9d56bc2b435bb9f229e2025649a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05dbf9f2-2043-4663-b07f-4be10df95b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05dbf9f2-2043-4663-b07f-4be10df95b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e629ff20-5d07-417f-b74e-ab977e8af634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e629ff20-5d07-417f-b74e-ab977e8af634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe00d568-73ae-4caa-9a09-d3df64b10756', 'volume_name': 'volume-fe00d568-73ae-4caa-9a09-d3df64b10756', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eced710f-fdc9-4f98-8017-63d84ce70839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eced710f-fdc9-4f98-8017-63d84ce70839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cdf0d3-d596-42db-99cb-dfc67accdfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:38 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume fe00d568-73ae-4caa-9a09-d3df64b10756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe00d568-73ae-4caa-9a09-d3df64b10756', 'volume_size': 1}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-255684624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe00d568-73ae-4caa-9a09-d3df64b10756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce75a66c2d541d7b548544c1fda9744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:23:38Z,use_quota=True,user_id='f31e9d56bc2b435bb9f229e2025649a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Creating volume fe00d568-73ae-4caa-9a09-d3df64b10756 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:23:38 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:23:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-fe00d568-73ae-4caa-9a09-d3df64b10756 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:38 devstack quobyte-client[84147]: System call of process 99357 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:23:38 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=128, name=volume-fe00d568-73ae-4caa-9a09-d3df64b10756, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-fe00d568-73ae-4caa-9a09-d3df64b10756 1073741824" returned: 0 in 0.638s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:39 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Flow 'volume_create_manager' (f234291c-b274-4859-a033-2dc038970eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ae0406-9e77-425f-9418-459a33b37c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-fe00d568-73ae-4caa-9a09-d3df64b10756 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ae0406-9e77-425f-9418-459a33b37c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2022833501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=504d9809-7889-43b0-9d23-c8b1ce869b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce75a66c2d541d7b548544c1fda9744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:23:39Z,use_quota=True,user_id='f31e9d56bc2b435bb9f229e2025649a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b5ebfe-da39-4050-932c-e88b092e6322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b5ebfe-da39-4050-932c-e88b092e6322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f919275f-cb6a-439e-8663-483b0c1b0c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f919275f-cb6a-439e-8663-483b0c1b0c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '504d9809-7889-43b0-9d23-c8b1ce869b71', 'volume_name': 'volume-504d9809-7889-43b0-9d23-c8b1ce869b71', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50fc8b3-8384-4be8-919a-9abd09f2c0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50fc8b3-8384-4be8-919a-9abd09f2c0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5eecdc-7cb6-42c3-9a10-c311f896273d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:39 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume 504d9809-7889-43b0-9d23-c8b1ce869b71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-504d9809-7889-43b0-9d23-c8b1ce869b71', 'volume_size': 1}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-fe00d568-73ae-4caa-9a09-d3df64b10756" returned: 0 in 0.627s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] <== create_volume: return (1453ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.094s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2022833501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=504d9809-7889-43b0-9d23-c8b1ce869b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce75a66c2d541d7b548544c1fda9744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:23:39Z,use_quota=True,user_id='f31e9d56bc2b435bb9f229e2025649a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Creating volume 504d9809-7889-43b0-9d23-c8b1ce869b71 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:23:39 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-504d9809-7889-43b0-9d23-c8b1ce869b71 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:40 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=129, name=volume-504d9809-7889-43b0-9d23-c8b1ce869b71, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:23:40 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Flow 'volume_create_manager' (e04d1b8a-31b4-4bbb-9fb9-6a83d480ce4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36f00a4-baec-45a9-8bf2-659f3cf0024b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Flow 'volume_create_manager' (9b5e5c4d-07f4-4607-8690-1aaa1b536b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7b442d-ee73-44ea-b6a8-e9aa990a670f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cdf0d3-d596-42db-99cb-dfc67accdfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe00d568-73ae-4caa-9a09-d3df64b10756', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e3a1b3-fd13-4ac4-8f2c-a2b1a07c21e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Flow 'volume_create_manager' (526967c9-936c-4baf-9ce7-b12ddcd507aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d6d20f-4c31-45a0-89e4-b9b6cfa18651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36f00a4-baec-45a9-8bf2-659f3cf0024b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-359593164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73028b1c-007a-46ce-88e2-cd8551edecaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce75a66c2d541d7b548544c1fda9744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:23:39Z,use_quota=True,user_id='f31e9d56bc2b435bb9f229e2025649a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b94e4db-678f-4862-b2fc-f524f1d22cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b94e4db-678f-4862-b2fc-f524f1d22cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c30c586-fe0e-4fa1-b6fd-9e87e2ed20bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c30c586-fe0e-4fa1-b6fd-9e87e2ed20bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73028b1c-007a-46ce-88e2-cd8551edecaf', 'volume_name': 'volume-73028b1c-007a-46ce-88e2-cd8551edecaf', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e37ab434-c0ec-4f90-a834-8408617efe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e37ab434-c0ec-4f90-a834-8408617efe61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d320254-72db-468b-8284-c5772af14240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume 73028b1c-007a-46ce-88e2-cd8551edecaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73028b1c-007a-46ce-88e2-cd8551edecaf', 'volume_size': 1}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7b442d-ee73-44ea-b6a8-e9aa990a670f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1610338649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab96665-32ae-4ac2-b81d-ab24cdea48bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce75a66c2d541d7b548544c1fda9744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:23:39Z,use_quota=True,user_id='f31e9d56bc2b435bb9f229e2025649a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5eb9d3-1ec1-4a99-8433-28250495ac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5eb9d3-1ec1-4a99-8433-28250495ac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4510221c-3d3a-488a-b916-153f234f1e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4510221c-3d3a-488a-b916-153f234f1e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab96665-32ae-4ac2-b81d-ab24cdea48bd', 'volume_name': 'volume-5ab96665-32ae-4ac2-b81d-ab24cdea48bd', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83300f62-43cb-48f0-878f-12056304847f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83300f62-43cb-48f0-878f-12056304847f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb69b4f-eeed-460a-a613-5f098477e312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume 5ab96665-32ae-4ac2-b81d-ab24cdea48bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab96665-32ae-4ac2-b81d-ab24cdea48bd', 'volume_size': 1}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d6d20f-4c31-45a0-89e4-b9b6cfa18651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-839863321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc415df-9ff8-4416-aade-bacc4ba57be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce75a66c2d541d7b548544c1fda9744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:23:40Z,use_quota=True,user_id='f31e9d56bc2b435bb9f229e2025649a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5185edd-f9c4-49f0-911b-f7af4dace515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5185edd-f9c4-49f0-911b-f7af4dace515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293ba1e3-2a5a-4039-98fd-5ebcd18b36f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293ba1e3-2a5a-4039-98fd-5ebcd18b36f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcc415df-9ff8-4416-aade-bacc4ba57be3', 'volume_name': 'volume-bcc415df-9ff8-4416-aade-bacc4ba57be3', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03532f28-5d1a-4c2d-a218-aba2da397a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03532f28-5d1a-4c2d-a218-aba2da397a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d148b5-4ca7-49a9-8c08-b542be27961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:40 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume bcc415df-9ff8-4416-aade-bacc4ba57be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcc415df-9ff8-4416-aade-bacc4ba57be3', 'volume_size': 1}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:40 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume volume-fe00d568-73ae-4caa-9a09-d3df64b10756 (fe00d568-73ae-4caa-9a09-d3df64b10756): created successfully
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e3a1b3-fd13-4ac4-8f2c-a2b1a07c21e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Flow 'volume_create_manager' (8d9eebdd-20a2-410b-96f8-cece3488d7f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-504d9809-7889-43b0-9d23-c8b1ce869b71 1073741824" returned: 0 in 0.827s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-504d9809-7889-43b0-9d23-c8b1ce869b71 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:41 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e3a3e70e-e15f-4d3e-9e63-160615c3fa45 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Created volume successfully.
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-504d9809-7889-43b0-9d23-c8b1ce869b71" returned: 0 in 0.331s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] <== create_volume: return (1184ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-359593164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73028b1c-007a-46ce-88e2-cd8551edecaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce75a66c2d541d7b548544c1fda9744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:23:39Z,use_quota=True,user_id='f31e9d56bc2b435bb9f229e2025649a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Creating volume 73028b1c-007a-46ce-88e2-cd8551edecaf {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:23:41 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-73028b1c-007a-46ce-88e2-cd8551edecaf 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:41 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=130, name=volume-73028b1c-007a-46ce-88e2-cd8551edecaf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5eecdc-7cb6-42c3-9a10-c311f896273d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-504d9809-7889-43b0-9d23-c8b1ce869b71', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f25266b-b805-4425-80ef-b1aa1a9464ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:41 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume volume-504d9809-7889-43b0-9d23-c8b1ce869b71 (504d9809-7889-43b0-9d23-c8b1ce869b71): created successfully
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f25266b-b805-4425-80ef-b1aa1a9464ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Flow 'volume_create_manager' (f234291c-b274-4859-a033-2dc038970eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-73028b1c-007a-46ce-88e2-cd8551edecaf 1073741824" returned: 0 in 0.478s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-73028b1c-007a-46ce-88e2-cd8551edecaf {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:41 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-43ad803d-b55c-4970-affd-4d3465e6323f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Created volume successfully.
Sep 18 01:23:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-73028b1c-007a-46ce-88e2-cd8551edecaf" returned: 0 in 0.269s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] <== create_volume: return (799ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.295s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1610338649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab96665-32ae-4ac2-b81d-ab24cdea48bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce75a66c2d541d7b548544c1fda9744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:23:39Z,use_quota=True,user_id='f31e9d56bc2b435bb9f229e2025649a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Creating volume 5ab96665-32ae-4ac2-b81d-ab24cdea48bd {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:23:42 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5ab96665-32ae-4ac2-b81d-ab24cdea48bd 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:42 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=131, name=volume-5ab96665-32ae-4ac2-b81d-ab24cdea48bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d320254-72db-468b-8284-c5772af14240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73028b1c-007a-46ce-88e2-cd8551edecaf', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617e95df-f236-42bb-90fe-b0a1c0855dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5ab96665-32ae-4ac2-b81d-ab24cdea48bd 1073741824" returned: 0 in 0.475s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5ab96665-32ae-4ac2-b81d-ab24cdea48bd {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:42 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume volume-73028b1c-007a-46ce-88e2-cd8551edecaf (73028b1c-007a-46ce-88e2-cd8551edecaf): created successfully
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617e95df-f236-42bb-90fe-b0a1c0855dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Flow 'volume_create_manager' (e04d1b8a-31b4-4bbb-9fb9-6a83d480ce4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5ab96665-32ae-4ac2-b81d-ab24cdea48bd" returned: 0 in 0.347s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] <== create_volume: return (857ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.150s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-839863321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc415df-9ff8-4416-aade-bacc4ba57be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce75a66c2d541d7b548544c1fda9744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:23:40Z,use_quota=True,user_id='f31e9d56bc2b435bb9f229e2025649a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Creating volume bcc415df-9ff8-4416-aade-bacc4ba57be3 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:23:42 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:23:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bcc415df-9ff8-4416-aade-bacc4ba57be3 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:43 devstack quobyte-client[84147]: System call of process 99382 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:23:43 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=132, name=volume-bcc415df-9ff8-4416-aade-bacc4ba57be3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:23:43 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-7b54c7e2-65b8-4ab9-92ae-cd787f146235 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Created volume successfully.
Sep 18 01:23:43 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb69b4f-eeed-460a-a613-5f098477e312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab96665-32ae-4ac2-b81d-ab24cdea48bd', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:43 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c191b84-e895-441e-9111-9ea5d3f118ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:43 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume volume-5ab96665-32ae-4ac2-b81d-ab24cdea48bd (5ab96665-32ae-4ac2-b81d-ab24cdea48bd): created successfully
Sep 18 01:23:43 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c191b84-e895-441e-9111-9ea5d3f118ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:43 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Flow 'volume_create_manager' (9b5e5c4d-07f4-4607-8690-1aaa1b536b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:23:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bcc415df-9ff8-4416-aade-bacc4ba57be3 1073741824" returned: 0 in 0.468s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bcc415df-9ff8-4416-aade-bacc4ba57be3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:43 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-bde6cd01-73b5-4779-9266-ad0c5cc1a4de tempest-CreateVolumesFromSnapshotTest-1643247051 None] Created volume successfully.
Sep 18 01:23:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bcc415df-9ff8-4416-aade-bacc4ba57be3" returned: 0 in 0.261s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:43 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] <== create_volume: return (758ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:23:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:43 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d148b5-4ca7-49a9-8c08-b542be27961b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc415df-9ff8-4416-aade-bacc4ba57be3', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:43 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171137d4-a64a-4cf3-abb7-e8c4e5129a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:23:43 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume volume-bcc415df-9ff8-4416-aade-bacc4ba57be3 (bcc415df-9ff8-4416-aade-bacc4ba57be3): created successfully
Sep 18 01:23:43 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171137d4-a64a-4cf3-abb7-e8c4e5129a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:23:43 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Flow 'volume_create_manager' (526967c9-936c-4baf-9ce7-b12ddcd507aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:23:43 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-c3ead333-e1cd-49c9-8ab9-8ebaeceb6d5d tempest-CreateVolumesFromSnapshotTest-1643247051 None] Created volume successfully.
Sep 18 01:23:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-bcc415df-9ff8-4416-aade-bacc4ba57be3-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-bcc415df-9ff8-4416-aade-bacc4ba57be3-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:45 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-quobyte-bcc415df-9ff8-4416-aade-bacc4ba57be3" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-bcc415df-9ff8-4416-aade-bacc4ba57be3" acquired by "delete_volume" :: waited 0.010s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:45 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc49a77-43be-4644-90ac-f65aed8903d7]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:23:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bcc415df-9ff8-4416-aade-bacc4ba57be3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bcc415df-9ff8-4416-aade-bacc4ba57be3" returned: 0 in 0.447s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bcc415df-9ff8-4416-aade-bacc4ba57be3 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bcc415df-9ff8-4416-aade-bacc4ba57be3" returned: 0 in 0.126s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-bcc415df-9ff8-4416-aade-bacc4ba57be3" released by "delete_volume" :: held 0.726s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:46 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Created reservations ['a87cf560-af46-4768-8cc5-21f89e3e296a', '21efbc10-e95f-48f1-9f78-1421af7cd754', '4c4e843a-da0d-424c-b171-7720f7cbb350', 'bfd0f697-f1f9-454a-9aaf-4dca97017136'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:23:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:23:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:23:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.104s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:46 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:23:46 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Deleted volume successfully.
Sep 18 01:23:46 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-70ea194d-61c7-4d9f-b340-fbd4a262ba9c tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-bcc415df-9ff8-4416-aade-bacc4ba57be3-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-73028b1c-007a-46ce-88e2-cd8551edecaf-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-73028b1c-007a-46ce-88e2-cd8551edecaf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:47 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-quobyte-73028b1c-007a-46ce-88e2-cd8551edecaf" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-73028b1c-007a-46ce-88e2-cd8551edecaf" acquired by "delete_volume" :: waited 0.012s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:47 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5f6d2f-775b-49b8-a657-2f9614d8197e]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:23:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-73028b1c-007a-46ce-88e2-cd8551edecaf {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-73028b1c-007a-46ce-88e2-cd8551edecaf" returned: 0 in 0.423s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-73028b1c-007a-46ce-88e2-cd8551edecaf {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-73028b1c-007a-46ce-88e2-cd8551edecaf" returned: 0 in 0.110s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:48 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-73028b1c-007a-46ce-88e2-cd8551edecaf" released by "delete_volume" :: held 0.688s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:48 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Created reservations ['6556bde1-8e76-414c-bafc-c2bcae943fad', '42c4a505-db80-47af-85d7-00a00e4d9304', 'fcd5074f-84b8-411f-ab73-c4b566c48e09', '3bd48dab-f4a0-4126-841e-1b0902bd3e2f'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:23:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:23:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:23:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.096s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:48 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:23:48 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Deleted volume successfully.
Sep 18 01:23:48 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8e61055b-507a-41bf-8e13-b56bbfa6ace2 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-73028b1c-007a-46ce-88e2-cd8551edecaf-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:49 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-5ab96665-32ae-4ac2-b81d-ab24cdea48bd-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:49 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-5ab96665-32ae-4ac2-b81d-ab24cdea48bd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:49 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:49 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-quobyte-5ab96665-32ae-4ac2-b81d-ab24cdea48bd" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:49 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-5ab96665-32ae-4ac2-b81d-ab24cdea48bd" acquired by "delete_volume" :: waited 0.012s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:49 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1c1f23-1fde-4091-8c27-2f4f83638995]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:23:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5ab96665-32ae-4ac2-b81d-ab24cdea48bd {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5ab96665-32ae-4ac2-b81d-ab24cdea48bd" returned: 0 in 0.419s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5ab96665-32ae-4ac2-b81d-ab24cdea48bd {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5ab96665-32ae-4ac2-b81d-ab24cdea48bd" returned: 0 in 0.084s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:50 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-5ab96665-32ae-4ac2-b81d-ab24cdea48bd" released by "delete_volume" :: held 0.657s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:50 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Created reservations ['19e5efd1-4a97-437c-8c02-5179279c7694', '62b8c08f-cd1f-4555-824e-b5685591c98c', '391899de-d62c-4b9c-a7c2-b83eb6d26f8e', '0dfba33d-70e0-4e9d-bda9-7199a79cadfd'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:23:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:23:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:23:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.108s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:51 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:23:51 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Deleted volume successfully.
Sep 18 01:23:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-02c0eeda-9021-4392-a978-a910e687f2db tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-5ab96665-32ae-4ac2-b81d-ab24cdea48bd-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-504d9809-7889-43b0-9d23-c8b1ce869b71-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-504d9809-7889-43b0-9d23-c8b1ce869b71-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:51 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-quobyte-504d9809-7889-43b0-9d23-c8b1ce869b71" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-504d9809-7889-43b0-9d23-c8b1ce869b71" acquired by "delete_volume" :: waited 0.013s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:51 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b3054f-9033-482b-92fc-a9f3531bf1d9]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:23:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-504d9809-7889-43b0-9d23-c8b1ce869b71 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-504d9809-7889-43b0-9d23-c8b1ce869b71" returned: 0 in 0.396s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-504d9809-7889-43b0-9d23-c8b1ce869b71 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-504d9809-7889-43b0-9d23-c8b1ce869b71" returned: 0 in 0.116s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-504d9809-7889-43b0-9d23-c8b1ce869b71" released by "delete_volume" :: held 0.672s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:52 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Created reservations ['5159bde7-1c10-48fc-ac71-1e85195a448f', '3ca64600-b2d6-49be-8e81-1fa893dc7ea0', 'fd077ae6-c99e-4e4e-b72e-fbeb5ea2db9c', 'c6c2d885-1440-40d4-98bc-fd3844de1127'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:23:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:23:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:23:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.086s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:53 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:23:53 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Deleted volume successfully.
Sep 18 01:23:53 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-c4b3040b-6ee5-46a7-9db7-1e50693ae602 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-504d9809-7889-43b0-9d23-c8b1ce869b71-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-fe00d568-73ae-4caa-9a09-d3df64b10756-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-fe00d568-73ae-4caa-9a09-d3df64b10756-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:54 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-quobyte-fe00d568-73ae-4caa-9a09-d3df64b10756" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-fe00d568-73ae-4caa-9a09-d3df64b10756" acquired by "delete_volume" :: waited 0.022s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:54 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa19faf9-03dc-478e-8e6b-68f6a066ba0d]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:23:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-fe00d568-73ae-4caa-9a09-d3df64b10756 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-fe00d568-73ae-4caa-9a09-d3df64b10756" returned: 0 in 0.390s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-fe00d568-73ae-4caa-9a09-d3df64b10756 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-fe00d568-73ae-4caa-9a09-d3df64b10756" returned: 0 in 0.121s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-fe00d568-73ae-4caa-9a09-d3df64b10756" released by "delete_volume" :: held 0.653s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:55 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Created reservations ['b195398f-af70-4246-9708-98d09a323c8e', 'e35c7cbc-4382-4a85-b5b2-ad14c85cba56', 'cd0f89de-0fb2-487d-8bc1-370220c5a1a5', '68adbecc-3738-4480-aadf-ab51677d99f3'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:23:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:23:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:23:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.086s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:55 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:23:55 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Deleted volume successfully.
Sep 18 01:23:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-917719c2-d32e-45ff-b90a-2144632fc80f tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-fe00d568-73ae-4caa-9a09-d3df64b10756-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-234f47b4-18fa-4ae3-abb8-9284abd9a1a8-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-234f47b4-18fa-4ae3-abb8-9284abd9a1a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:56 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-quobyte-bbf409eb-d327-4fa3-ba8d-84a39d86d571" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-bbf409eb-d327-4fa3-ba8d-84a39d86d571" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-quobyte-234f47b4-18fa-4ae3-abb8-9284abd9a1a8" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-234f47b4-18fa-4ae3-abb8-9284abd9a1a8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Deleting offline snapshot 234f47b4-18fa-4ae3-abb8-9284abd9a1a8 of volume bbf409eb-d327-4fa3-ba8d-84a39d86d571 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:23:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] snapshot_file for this snap is: volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:23:56 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[327bf18c-fbcb-4623-a8be-79eab4415ff3]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:23:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8" returned: 0 in 0.380s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:23:56 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[115e6630-8080-4430-a7aa-e1deccf9c08f]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:23:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571" returned: 0 in 0.375s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:57 devstack quobyte-client[84147]: System call of process 99446 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8" returned: 0 in 0.226s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571.234f47b4-18fa-4ae3-abb8-9284abd9a1a8" returned: 0 in 0.086s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-234f47b4-18fa-4ae3-abb8-9284abd9a1a8" released by "_delete_snapshot" :: held 1.524s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.187s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:23:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:23:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-bbf409eb-d327-4fa3-ba8d-84a39d86d571" released by "delete_snapshot" :: held 1.657s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:58 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Created reservations ['b4d965b9-8178-4d6a-91f2-a27a0563b04e', 'e3c96b77-fcb8-44b4-a78e-5643c32ca4ce', '42e3246b-dd4a-48cc-a2a8-4a2c58a250cd', 'e65b570b-916b-46b8-88f9-838b492b123d'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:23:58 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Delete snapshot completed successfully.
Sep 18 01:23:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e75ff84a-c6e1-4457-a0c8-36645eeb3fa5 tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-234f47b4-18fa-4ae3-abb8-9284abd9a1a8-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:23:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-bbf409eb-d327-4fa3-ba8d-84a39d86d571-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-bbf409eb-d327-4fa3-ba8d-84a39d86d571-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:59 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:23:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "cinder-quobyte-bbf409eb-d327-4fa3-ba8d-84a39d86d571" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:23:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-bbf409eb-d327-4fa3-ba8d-84a39d86d571" acquired by "delete_volume" :: waited 0.013s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:23:59 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb0cab5-9d0b-4f11-b82c-897267feae61]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:23:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571" returned: 0 in 0.398s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-bbf409eb-d327-4fa3-ba8d-84a39d86d571" returned: 0 in 0.102s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:00 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-quobyte-bbf409eb-d327-4fa3-ba8d-84a39d86d571" released by "delete_volume" :: held 0.653s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:00 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Created reservations ['806b556f-52ad-487d-9a13-8a909ed20386', 'd0eba671-05fe-4efe-8e10-ee1c71e680c7', '1537d7ac-2c03-41b3-9f6d-8bdb58a23f21', 'f8c997f6-1dc8-4ebe-a22c-3245734c0816'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:24:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:24:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:24:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:24:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:24:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:24:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.126s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:00 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:24:00 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Deleted volume successfully.
Sep 18 01:24:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-1821ef4d-4fe6-4943-922f-37cad2c23bab tempest-CreateVolumesFromSnapshotTest-1643247051 None] Lock "cinder-bbf409eb-d327-4fa3-ba8d-84a39d86d571-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:10 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=47,cinder:UPDATE=66,cinder:DELETE=6,cinder:INSERT=9 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:24:11 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=48,cinder:UPDATE=70,cinder:DELETE=7,cinder:INSERT=19 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:24:11 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-dc38aa63-999e-4ac7-9d5d-cc0b1687f1cd req-d634d9b9-728b-4cf2-9e3b-1b8933693943 tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:11 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-dc38aa63-999e-4ac7-9d5d-cc0b1687f1cd req-d634d9b9-728b-4cf2-9e3b-1b8933693943 tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:11 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-dc38aa63-999e-4ac7-9d5d-cc0b1687f1cd req-d634d9b9-728b-4cf2-9e3b-1b8933693943 tempest-TestInstancesWithCinderVolumes-302585926 None] Terminate volume connection completed successfully.
Sep 18 01:24:11 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-dc38aa63-999e-4ac7-9d5d-cc0b1687f1cd req-d634d9b9-728b-4cf2-9e3b-1b8933693943 tempest-TestInstancesWithCinderVolumes-302585926 None] Deleting attachment 88c41d1e-d43c-4fa3-8349-5543b2797f2f. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:24:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "cinder-39445fae-c85f-46b4-969c-f037ef2b66bd-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "cinder-39445fae-c85f-46b4-969c-f037ef2b66bd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:13 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "cinder-quobyte-39445fae-c85f-46b4-969c-f037ef2b66bd" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "cinder-quobyte-39445fae-c85f-46b4-969c-f037ef2b66bd" acquired by "delete_volume" :: waited 0.012s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:13 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b2cb0f-39cd-44e5-bc0f-8d738a8569bd]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:24:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-39445fae-c85f-46b4-969c-f037ef2b66bd {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:13 devstack quobyte-client[84147]: System call of process 99467 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:24:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-39445fae-c85f-46b4-969c-f037ef2b66bd" returned: 0 in 0.570s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-39445fae-c85f-46b4-969c-f037ef2b66bd {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-39445fae-c85f-46b4-969c-f037ef2b66bd" returned: 0 in 0.123s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:14 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "cinder-quobyte-39445fae-c85f-46b4-969c-f037ef2b66bd" released by "delete_volume" :: held 0.896s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:14 devstack cinder-volume[84134]: WARNING cinder.quota [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-201218134-1880139261 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-201218134-1880139261, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:24:14 devstack cinder-volume[84134]: WARNING cinder.quota [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-201218134-1880139261 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-201218134-1880139261, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:24:14 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Created reservations ['0dab5b42-f6a5-4b00-94da-0e42010a8904', 'f03394ce-dd0d-405a-a80c-7114e0b4e08f', '35cbd6f2-c630-4a8d-ab15-2b94b444f5dd', '11f4a84b-bc43-4d89-8592-dd2de4d2e7b8'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:24:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:24:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:24:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:24:14 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:24:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:24:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.139s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:14 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:24:15 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Deleted volume successfully.
Sep 18 01:24:15 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bda64fe9-6fcd-4f9b-9885-d73aeac54a6e tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "cinder-39445fae-c85f-46b4-969c-f037ef2b66bd-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:24:24 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Flow 'volume_create_manager' (ec9a2170-fece-4031-ac4a-e96ff0fc1019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ecccb3-dbc0-4a75-8328-d5b5f0fa63b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ecccb3-dbc0-4a75-8328-d5b5f0fa63b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1023496467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c2aaa6-852f-43cc-81e8-b6a9c149c5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b51f8afa854eb6ab6460682bf6cde4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:24:25Z,use_quota=True,user_id='c6d4c32a0f034c8fac624f0df2bb7afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b29736-f5fb-4d13-925a-a1ac9cb8b347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b29736-f5fb-4d13-925a-a1ac9cb8b347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c90b433e-3311-4097-ad47-ae7c914a9e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c90b433e-3311-4097-ad47-ae7c914a9e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62c2aaa6-852f-43cc-81e8-b6a9c149c5c5', 'volume_name': 'volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12110335-6c56-4c21-904b-4ddb1b2e98ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12110335-6c56-4c21-904b-4ddb1b2e98ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686f99b1-de15-4971-aa25-3353f4cb5c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:24:24 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Volume 62c2aaa6-852f-43cc-81e8-b6a9c149c5c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5', 'volume_size': 1}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1023496467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c2aaa6-852f-43cc-81e8-b6a9c149c5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b51f8afa854eb6ab6460682bf6cde4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:24:25Z,use_quota=True,user_id='c6d4c32a0f034c8fac624f0df2bb7afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Creating volume 62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:24:24 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:24:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:24:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:24:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:24:25 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:24:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:25 devstack quobyte-client[84147]: System call of process 99538 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:24:25 devstack quobyte-client[84147]: System call of process 99538 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:24:25 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=133, name=volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:24:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 1073741824" returned: 0 in 0.324s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5" returned: 0 in 0.085s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] <== create_volume: return (479ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:24:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.494s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:24:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686f99b1-de15-4971-aa25-3353f4cb5c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:24:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81809768-1a85-41b6-b934-cb15ed94c880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:24:25 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Volume volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 (62c2aaa6-852f-43cc-81e8-b6a9c149c5c5): created successfully
Sep 18 01:24:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81809768-1a85-41b6-b934-cb15ed94c880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:24:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Flow 'volume_create_manager' (ec9a2170-fece-4031-ac4a-e96ff0fc1019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:24:25 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-23cae9b9-46e2-43aa-9a43-1d5ba2fc0feb tempest-SnapshotDependencyTests-1701089115 None] Created volume successfully.
Sep 18 01:24:27 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:24:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:24:27 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] Creating offline snapshot d8a0f911-b7ab-4fc4-9f82-6a70280c7a21 of volume 62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:24:27 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[95463fe8-fdf7-4922-a6d7-65761dd59251]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:24:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5" returned: 0 in 0.402s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:27 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=134, name=volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21 1G" returned: 0 in 0.227s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): qemu-img rebase -u -b volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:28 devstack quobyte-client[84147]: System call of process 99548 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] CMD "qemu-img rebase -u -b volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21" returned: 0 in 0.120s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21" returned: 0 in 0.084s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21" returned: 0 in 0.123s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.info" returned: 0 in 0.112s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.info" returned: 0 in 0.110s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.496s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:24:29 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-f695a994-136c-4120-8728-5e503d217d04 tempest-SnapshotDependencyTests-1701089115 None] Create snapshot completed successfully
Sep 18 01:24:30 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:30 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:24:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Flow 'volume_create_manager' (3f86aaab-8c6c-4eb3-82db-8e1df91c255f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:24:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13cb51b-1179-4e6c-9b24-93c85476c00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:24:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13cb51b-1179-4e6c-9b24-93c85476c00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e1aab7-3177-4986-90f2-a1ab3f1ea614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b51f8afa854eb6ab6460682bf6cde4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8a0f911-b7ab-4fc4-9f82-6a70280c7a21,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:24:31Z,use_quota=True,user_id='c6d4c32a0f034c8fac624f0df2bb7afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:24:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c10e1f-c877-4892-b27f-ff938f1798f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:24:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c10e1f-c877-4892-b27f-ff938f1798f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:24:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1751a468-d980-486f-afc3-1094ad0617d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:24:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1751a468-d980-486f-afc3-1094ad0617d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '58e1aab7-3177-4986-90f2-a1ab3f1ea614', 'volume_name': 'volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614', 'volume_size': 1, 'snapshot_id': 'd8a0f911-b7ab-4fc4-9f82-6a70280c7a21'}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:24:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef1a019-8923-425b-8563-8db2899a304a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:24:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef1a019-8923-425b-8563-8db2899a304a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:24:30 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91c5992-fd5c-4342-b302-5a1bc93e6d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:24:30 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Volume 58e1aab7-3177-4986-90f2-a1ab3f1ea614: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614', 'volume_size': 1, 'snapshot_id': 'd8a0f911-b7ab-4fc4-9f82-6a70280c7a21'}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "cinder-quobyte-d8a0f911-b7ab-4fc4-9f82-6a70280c7a21-58e1aab7-3177-4986-90f2-a1ab3f1ea614" by "_create_volume_from_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-quobyte-d8a0f911-b7ab-4fc4-9f82-6a70280c7a21-58e1aab7-3177-4986-90f2-a1ab3f1ea614" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Creating volume 58e1aab7-3177-4986-90f2-a1ab3f1ea614 from snapshot d8a0f911-b7ab-4fc4-9f82-6a70280c7a21 {{(pid=84134) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "cinder-quobyte-58e1aab7-3177-4986-90f2-a1ab3f1ea614" by "_copy_volume_from_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-quobyte-58e1aab7-3177-4986-90f2-a1ab3f1ea614" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] snapshot: d8a0f911-b7ab-4fc4-9f82-6a70280c7a21, volume: 58e1aab7-3177-4986-90f2-a1ab3f1ea614,  {{(pid=84134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56dfafe-d78c-4907-8ddb-ed184c347013]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21" returned: 0 in 0.369s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] will copy from snapshot at /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 {{(pid=84134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Creating direct copy from snapshot {{(pid=84134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[77aeeedc-e328-4762-ad3f-1787fb35a893]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5" returned: 0 in 0.375s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG cinder.utils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614 not found in is_blk_device check {{(pid=84134) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 01:24:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:32 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=136, name=volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:24:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614" returned: 0 in 4.197s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:36 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f65d71b-76b2-4212-94c1-32a8f2b65dab]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:24:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5" returned: 0 in 0.537s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:36 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Image conversion details: src /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5, size 1024.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614 {{(pid=84134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 01:24:36 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Converted 1024.00 MB image at 242.60 MB/s
Sep 18 01:24:36 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:24:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614" returned: 0 in 0.087s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:36 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-quobyte-58e1aab7-3177-4986-90f2-a1ab3f1ea614" released by "_copy_volume_from_snapshot" :: held 5.905s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:36 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-quobyte-d8a0f911-b7ab-4fc4-9f82-6a70280c7a21-58e1aab7-3177-4986-90f2-a1ab3f1ea614" released by "_create_volume_from_snapshot" :: held 5.939s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.958s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:24:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91c5992-fd5c-4342-b302-5a1bc93e6d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614', 'volume_size': 1, 'snapshot_id': 'd8a0f911-b7ab-4fc4-9f82-6a70280c7a21'}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:24:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5933d94c-8d07-40b3-b928-fd627ee78e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:24:37 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Volume volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614 (58e1aab7-3177-4986-90f2-a1ab3f1ea614): created successfully
Sep 18 01:24:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5933d94c-8d07-40b3-b928-fd627ee78e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:24:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Flow 'volume_create_manager' (3f86aaab-8c6c-4eb3-82db-8e1df91c255f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:24:37 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-03839826-6a17-4bab-bff7-58840e73c66b tempest-SnapshotDependencyTests-1701089115 None] Created volume successfully.
Sep 18 01:24:37 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "cinder-d8a0f911-b7ab-4fc4-9f82-6a70280c7a21-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:37 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-d8a0f911-b7ab-4fc4-9f82-6a70280c7a21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:37 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:37 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "cinder-quobyte-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:37 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-quobyte-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:37 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "cinder-quobyte-d8a0f911-b7ab-4fc4-9f82-6a70280c7a21" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:37 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-quobyte-d8a0f911-b7ab-4fc4-9f82-6a70280c7a21" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Deleting offline snapshot d8a0f911-b7ab-4fc4-9f82-6a70280c7a21 of volume 62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:24:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] snapshot_file for this snap is: volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:24:37 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[71af7525-c960-42a2-a674-b807f18b0786]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:24:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21" returned: 0 in 0.361s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:24:38 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdefc79c-d954-4959-8b11-08eb39d6a8cf]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:24:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5" returned: 0 in 0.389s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21" returned: 0 in 0.181s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5.d8a0f911-b7ab-4fc4-9f82-6a70280c7a21" returned: 0 in 0.171s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:39 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-quobyte-d8a0f911-b7ab-4fc4-9f82-6a70280c7a21" released by "_delete_snapshot" :: held 1.319s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:39 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-quobyte-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5" released by "delete_snapshot" :: held 1.343s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:39 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Created reservations ['2e2aff21-2e07-4f4b-b654-aab7299ac6e9', '01c920dd-cf99-4adc-88e9-59e0c3a95e9e', '3d51d56e-b919-4963-ab08-559c69b34b8f', 'd061a666-9b7c-49e9-a13f-e0368fc10913'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:24:39 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Delete snapshot completed successfully.
Sep 18 01:24:39 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-eea3523d-73e1-4333-b994-d74b1736bf9c tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-d8a0f911-b7ab-4fc4-9f82-6a70280c7a21-delete_snapshot" released by "delete_snapshot" :: held 1.777s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "cinder-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:40 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "cinder-quobyte-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-quobyte-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5" acquired by "delete_volume" :: waited 0.009s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:40 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22d431b-8d97-43ec-9b49-8c84871a7e2b]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:24:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5" returned: 0 in 0.382s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5" returned: 0 in 0.116s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:40 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-quobyte-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5" released by "delete_volume" :: held 0.667s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:41 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Created reservations ['c38cdb1c-c648-468b-819b-d09741ac6903', 'beee1c4e-bdf6-4bbf-81bb-b1a1eb67b275', 'ebb7a755-8ddb-477f-ab93-a75e6b35653b', 'c3aab5c0-1976-41dd-affd-9180708a2b19'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:24:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:24:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:24:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:24:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:24:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:24:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.081s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:41 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:24:41 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Deleted volume successfully.
Sep 18 01:24:41 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-3e555a36-481b-4bda-ad05-d905d12e589a tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-62c2aaa6-852f-43cc-81e8-b6a9c149c5c5-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:42 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-a94acbbb-147f-4a38-8971-8eda2de5e74c req-a0d88bd9-3d7b-4b1c-a8ba-4112f3d6efa4 tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:42 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-a94acbbb-147f-4a38-8971-8eda2de5e74c req-a0d88bd9-3d7b-4b1c-a8ba-4112f3d6efa4 tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:42 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-a94acbbb-147f-4a38-8971-8eda2de5e74c req-a0d88bd9-3d7b-4b1c-a8ba-4112f3d6efa4 tempest-TestInstancesWithCinderVolumes-302585926 None] Terminate volume connection completed successfully.
Sep 18 01:24:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-a94acbbb-147f-4a38-8971-8eda2de5e74c req-a0d88bd9-3d7b-4b1c-a8ba-4112f3d6efa4 tempest-TestInstancesWithCinderVolumes-302585926 None] Deleting attachment c63a3d5b-a2bc-445d-b228-f9df5df74453. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:24:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "cinder-58e1aab7-3177-4986-90f2-a1ab3f1ea614-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-58e1aab7-3177-4986-90f2-a1ab3f1ea614-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:42 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "cinder-quobyte-58e1aab7-3177-4986-90f2-a1ab3f1ea614" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-quobyte-58e1aab7-3177-4986-90f2-a1ab3f1ea614" acquired by "delete_volume" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:42 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f807f99a-7194-4b1c-b542-d84c182014bf]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:24:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614" returned: 0 in 0.383s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:42 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-58e1aab7-3177-4986-90f2-a1ab3f1ea614" returned: 0 in 0.088s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-quobyte-58e1aab7-3177-4986-90f2-a1ab3f1ea614" released by "delete_volume" :: held 0.674s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:43 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Created reservations ['b39c4961-18fd-42a4-ba3a-0c51524e234d', 'a22fe989-86c9-4f79-9ddd-7c732ae7f953', '0ac0345b-8fc8-4e1b-ba12-f1b0de88f01e', 'bd8c6b31-99b6-4852-9ea5-15e6a2498131'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:24:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:24:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:24:43 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:24:43 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:24:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:24:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.115s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:43 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:24:43 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Deleted volume successfully.
Sep 18 01:24:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ce4e1a7d-5700-4ce7-be59-64249909f8c1 tempest-SnapshotDependencyTests-1701089115 None] Lock "cinder-58e1aab7-3177-4986-90f2-a1ab3f1ea614-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "cinder-dadb6961-7921-49f6-9552-c81d1ce20d61-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "cinder-dadb6961-7921-49f6-9552-c81d1ce20d61-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:44 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "cinder-quobyte-dadb6961-7921-49f6-9552-c81d1ce20d61" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "cinder-quobyte-dadb6961-7921-49f6-9552-c81d1ce20d61" acquired by "delete_volume" :: waited 0.014s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:44 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbc501b-eab8-4d40-acfc-8eb12a7b8a0c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:24:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-dadb6961-7921-49f6-9552-c81d1ce20d61 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-dadb6961-7921-49f6-9552-c81d1ce20d61" returned: 0 in 0.661s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-dadb6961-7921-49f6-9552-c81d1ce20d61 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-dadb6961-7921-49f6-9552-c81d1ce20d61" returned: 0 in 0.162s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "cinder-quobyte-dadb6961-7921-49f6-9552-c81d1ce20d61" released by "delete_volume" :: held 1.002s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:45 devstack cinder-volume[84134]: WARNING cinder.quota [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1482299437-872864418 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1482299437-872864418, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:24:45 devstack cinder-volume[84134]: WARNING cinder.quota [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1482299437-872864418 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1482299437-872864418, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:24:45 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Created reservations ['d154fe0e-f7ce-4f81-bdfb-cd4d7da99fce', 'e7faf8af-0272-485b-a2fc-11c7b576857a', 'eedd7128-ab28-45be-800e-04562391a096', '85f00cb4-bbd0-4505-b76b-29c5fa79a3d1'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:24:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:24:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:24:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:24:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:24:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:24:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.155s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:46 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:24:46 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Deleted volume successfully.
Sep 18 01:24:46 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-fccd662f-3a0b-4c6f-a084-60e103303f31 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "cinder-dadb6961-7921-49f6-9552-c81d1ce20d61-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:24:54 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-daf7ea18-ed96-48c9-a025-78166ae31593 req-3c9d7977-99c5-461a-8d4c-1238d129517e tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:54 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-daf7ea18-ed96-48c9-a025-78166ae31593 req-3c9d7977-99c5-461a-8d4c-1238d129517e tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:54 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-daf7ea18-ed96-48c9-a025-78166ae31593 req-3c9d7977-99c5-461a-8d4c-1238d129517e tempest-TestInstancesWithCinderVolumes-302585926 None] Terminate volume connection completed successfully.
Sep 18 01:24:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-daf7ea18-ed96-48c9-a025-78166ae31593 req-3c9d7977-99c5-461a-8d4c-1238d129517e tempest-TestInstancesWithCinderVolumes-302585926 None] Deleting attachment df0b1d9e-cb42-4dc7-a6d6-9ee4425d2ee3. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:24:56 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=27,cinder:UPDATE=35,cinder:DELETE=5,cinder:INSERT=8 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:24:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:24:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:24:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:24:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:24:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:24:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:24:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:24:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.125s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:24:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:24:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "cinder-4d871cd3-3e0b-4e80-ac15-83ce69454883-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "cinder-4d871cd3-3e0b-4e80-ac15-83ce69454883-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:59 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:24:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "cinder-quobyte-4d871cd3-3e0b-4e80-ac15-83ce69454883" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:24:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "cinder-quobyte-4d871cd3-3e0b-4e80-ac15-83ce69454883" acquired by "delete_volume" :: waited 0.013s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:24:59 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[684a58f8-ac1e-478b-9797-2180472d33dd]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:24:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:25:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883" returned: 0 in 0.491s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:25:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:25:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883" returned: 1 in 0.451s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:25:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:25:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:25:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4d871cd3-3e0b-4e80-ac15-83ce69454883" returned: 0 in 0.099s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:25:00 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "cinder-quobyte-4d871cd3-3e0b-4e80-ac15-83ce69454883" released by "delete_volume" :: held 1.316s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:25:00 devstack cinder-volume[84134]: WARNING cinder.quota [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1223951917-1552679664 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1223951917-1552679664, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:25:00 devstack cinder-volume[84134]: WARNING cinder.quota [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1223951917-1552679664 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1223951917-1552679664, it is now deprecated. Please use the default quota class for default quota.
Sep 18 01:25:01 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Created reservations ['6c303ac7-4098-4700-821b-66dee66b0048', 'a547929a-5e9c-46f2-b86a-6365bf6912b2', 'ba313c90-cd96-42ed-ba4e-090c1bebe760', 'd07feb20-e8f8-490e-8ffc-ff273ad3bb62'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:25:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:25:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:25:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:25:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:25:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:25:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:25:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.135s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:25:01 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:25:01 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Deleted volume successfully.
Sep 18 01:25:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b070ac00-8773-483f-9e62-e5e700f37302 tempest-TestInstancesWithCinderVolumes-302585926 None] Lock "cinder-4d871cd3-3e0b-4e80-ac15-83ce69454883-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:25:11 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=38,cinder:UPDATE=50,cinder:INSERT=11,cinder:DELETE=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:25:11 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=6,cinder:SELECT=3,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:25:26 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:25:39 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:25:39 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:25:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Flow 'volume_create_manager' (6be1504d-c82b-4442-8617-e8cd883103e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:25:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb7c8d6-684e-4f4c-bba1-30fb3b617797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb7c8d6-684e-4f4c-bba1-30fb3b617797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2134002576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0e0a2c-2777-4f89-9d8f-ed401ff95760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3259d27bacb4518bb37f69f60b8f2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:25:40Z,use_quota=True,user_id='0c1c299baf3e4b6da7d8fdf18fa64174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080291c1-d1bc-4a02-84c5-beed73f1644e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080291c1-d1bc-4a02-84c5-beed73f1644e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39989e25-6196-4611-a3d2-b3980e4417a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39989e25-6196-4611-a3d2-b3980e4417a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a0e0a2c-2777-4f89-9d8f-ed401ff95760', 'volume_name': 'volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce6d95e-c81c-455a-874d-b6fc8f593e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce6d95e-c81c-455a-874d-b6fc8f593e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4833853-9e99-4b10-959a-4449d0e51348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:25:40 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume 5a0e0a2c-2777-4f89-9d8f-ed401ff95760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760', 'volume_size': 1}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2134002576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0e0a2c-2777-4f89-9d8f-ed401ff95760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3259d27bacb4518bb37f69f60b8f2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:25:40Z,use_quota=True,user_id='0c1c299baf3e4b6da7d8fdf18fa64174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Creating volume 5a0e0a2c-2777-4f89-9d8f-ed401ff95760 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:25:40 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:25:40 devstack quobyte-client[84147]: System call of process 100191 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:25:40 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=137, name=volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:25:40 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Flow 'volume_create_manager' (d4f7566e-4be9-4d6a-8cb5-daf83f8af126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a4cfed-1800-473a-b8ff-ae7c5628c177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760 1073741824" returned: 0 in 0.642s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:25:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a4cfed-1800-473a-b8ff-ae7c5628c177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-109341569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4bc5db-7820-4e78-b1fd-1329d4bfffcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3259d27bacb4518bb37f69f60b8f2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:25:40Z,use_quota=True,user_id='0c1c299baf3e4b6da7d8fdf18fa64174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d113aa43-c297-44ee-84a6-448c1d18deb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d113aa43-c297-44ee-84a6-448c1d18deb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a61dcfc-7615-42f7-9ef1-ba9e56274c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a61dcfc-7615-42f7-9ef1-ba9e56274c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b4bc5db-7820-4e78-b1fd-1329d4bfffcd', 'volume_name': 'volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4578ed8-549e-4af7-971f-fe9b8ff56cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4578ed8-549e-4af7-971f-fe9b8ff56cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920db1cf-e9c2-4869-9522-889348cad282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:25:41 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume 0b4bc5db-7820-4e78-b1fd-1329d4bfffcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd', 'volume_size': 1}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760" returned: 0 in 0.302s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] <== create_volume: return (1000ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.094s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-109341569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4bc5db-7820-4e78-b1fd-1329d4bfffcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3259d27bacb4518bb37f69f60b8f2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:25:40Z,use_quota=True,user_id='0c1c299baf3e4b6da7d8fdf18fa64174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Creating volume 0b4bc5db-7820-4e78-b1fd-1329d4bfffcd {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:25:41 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:25:41 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=138, name=volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4833853-9e99-4b10-959a-4449d0e51348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcc4212-46e6-4947-b4c9-62e27f6862f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:25:41 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760 (5a0e0a2c-2777-4f89-9d8f-ed401ff95760): created successfully
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcc4212-46e6-4947-b4c9-62e27f6862f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Flow 'volume_create_manager' (6be1504d-c82b-4442-8617-e8cd883103e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd 1073741824" returned: 0 in 0.476s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:25:41 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-424b45ad-4a8d-4563-ae44-afcb85e149ae tempest-TestServerVolumeAttachmentScenario-58157792 None] Created volume successfully.
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd" returned: 0 in 0.284s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] <== create_volume: return (787ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:25:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:25:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920db1cf-e9c2-4869-9522-889348cad282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:25:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84470d5-f965-485d-b1be-4ffa73bb590c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:25:42 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd (0b4bc5db-7820-4e78-b1fd-1329d4bfffcd): created successfully
Sep 18 01:25:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84470d5-f965-485d-b1be-4ffa73bb590c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:25:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Flow 'volume_create_manager' (d4f7566e-4be9-4d6a-8cb5-daf83f8af126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:25:42 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-a46a00a2-eeb0-40a3-8b1f-eaf43c8ce139 tempest-TestServerVolumeAttachmentScenario-58157792 None] Created volume successfully.
Sep 18 01:25:52 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:25:52 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:25:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:25:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:25:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:25:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:25:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:25:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:25:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:25:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.111s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:25:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:26:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:26:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:26:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:26:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:26:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:26:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:26:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:26:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.092s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:26:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:27:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-a6b122d6-1d0c-4eb1-85ab-b0581f6fd853 req-c3a6d4b1-e5dc-4042-968c-909f63a89b42 tempest-TestServerVolumeAttachmentScenario-58157792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:27:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-a6b122d6-1d0c-4eb1-85ab-b0581f6fd853 req-c3a6d4b1-e5dc-4042-968c-909f63a89b42 tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:27:16 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[041c9957-b85b-4fe3-9de5-3f9d23d8067c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:27:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-a6b122d6-1d0c-4eb1-85ab-b0581f6fd853 req-c3a6d4b1-e5dc-4042-968c-909f63a89b42 tempest-TestServerVolumeAttachmentScenario-58157792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:27:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-a6b122d6-1d0c-4eb1-85ab-b0581f6fd853 req-c3a6d4b1-e5dc-4042-968c-909f63a89b42 tempest-TestServerVolumeAttachmentScenario-58157792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760" returned: 0 in 0.505s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:27:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-a6b122d6-1d0c-4eb1-85ab-b0581f6fd853 req-c3a6d4b1-e5dc-4042-968c-909f63a89b42 tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.568s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:27:16 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-a6b122d6-1d0c-4eb1-85ab-b0581f6fd853 req-c3a6d4b1-e5dc-4042-968c-909f63a89b42 tempest-TestServerVolumeAttachmentScenario-58157792 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3432c18-9caa-40aa-b8cd-ec4971dedcdb', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:27:16 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-a6b122d6-1d0c-4eb1-85ab-b0581f6fd853 req-c3a6d4b1-e5dc-4042-968c-909f63a89b42 tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:27:16 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-a6b122d6-1d0c-4eb1-85ab-b0581f6fd853 req-c3a6d4b1-e5dc-4042-968c-909f63a89b42 tempest-TestServerVolumeAttachmentScenario-58157792 None] attachment_update completed successfully.
Sep 18 01:27:26 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=7 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:27:26 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:27:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-843e36bc-979d-47c0-b6c8-4509404570c4 req-d8c7d071-b4fb-4416-9878-017a77bcbd44 tempest-TestServerVolumeAttachmentScenario-58157792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:27:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-843e36bc-979d-47c0-b6c8-4509404570c4 req-d8c7d071-b4fb-4416-9878-017a77bcbd44 tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:27:27 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[260dc3df-f785-4b07-b242-13b08fe8ff5d]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:27:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-843e36bc-979d-47c0-b6c8-4509404570c4 req-d8c7d071-b4fb-4416-9878-017a77bcbd44 tempest-TestServerVolumeAttachmentScenario-58157792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:27:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [req-843e36bc-979d-47c0-b6c8-4509404570c4 req-d8c7d071-b4fb-4416-9878-017a77bcbd44 tempest-TestServerVolumeAttachmentScenario-58157792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd" returned: 0 in 0.381s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:27:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [req-843e36bc-979d-47c0-b6c8-4509404570c4 req-d8c7d071-b4fb-4416-9878-017a77bcbd44 tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.436s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:27:28 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-843e36bc-979d-47c0-b6c8-4509404570c4 req-d8c7d071-b4fb-4416-9878-017a77bcbd44 tempest-TestServerVolumeAttachmentScenario-58157792 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876', 'name': 'volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36c34eef-e2fe-412f-8c0c-5b240594f7fa', 'enforce_multipath': True} {{(pid=84134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 01:27:28 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-843e36bc-979d-47c0-b6c8-4509404570c4 req-d8c7d071-b4fb-4416-9878-017a77bcbd44 tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:27:28 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-843e36bc-979d-47c0-b6c8-4509404570c4 req-d8c7d071-b4fb-4416-9878-017a77bcbd44 tempest-TestServerVolumeAttachmentScenario-58157792 None] attachment_update completed successfully.
Sep 18 01:27:38 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:27:38 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:27:55 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-a4097733-f72c-47cb-8a3a-a2d0a6e6b7f2 req-a1cef67a-dacb-4b5e-8d9f-2c96b18f3260 tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:27:55 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-a4097733-f72c-47cb-8a3a-a2d0a6e6b7f2 req-a1cef67a-dacb-4b5e-8d9f-2c96b18f3260 tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:27:55 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-a4097733-f72c-47cb-8a3a-a2d0a6e6b7f2 req-a1cef67a-dacb-4b5e-8d9f-2c96b18f3260 tempest-TestServerVolumeAttachmentScenario-58157792 None] Terminate volume connection completed successfully.
Sep 18 01:27:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-a4097733-f72c-47cb-8a3a-a2d0a6e6b7f2 req-a1cef67a-dacb-4b5e-8d9f-2c96b18f3260 tempest-TestServerVolumeAttachmentScenario-58157792 None] Deleting attachment 36c34eef-e2fe-412f-8c0c-5b240594f7fa. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:27:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:27:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:27:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:27:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:27:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:27:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:27:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:27:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.082s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:27:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:28:05 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:28:05 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:28:19 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-ec5549e1-8314-40f5-ac45-521816cf4f58 req-d31447fc-2edd-4e08-afbf-0b3fa0d10264 tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:28:19 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [req-ec5549e1-8314-40f5-ac45-521816cf4f58 req-d31447fc-2edd-4e08-afbf-0b3fa0d10264 tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:28:19 devstack cinder-volume[84134]: INFO cinder.volume.manager [req-ec5549e1-8314-40f5-ac45-521816cf4f58 req-d31447fc-2edd-4e08-afbf-0b3fa0d10264 tempest-TestServerVolumeAttachmentScenario-58157792 None] Terminate volume connection completed successfully.
Sep 18 01:28:19 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [req-ec5549e1-8314-40f5-ac45-521816cf4f58 req-d31447fc-2edd-4e08-afbf-0b3fa0d10264 tempest-TestServerVolumeAttachmentScenario-58157792 None] Deleting attachment f3432c18-9caa-40aa-b8cd-ec4971dedcdb. {{(pid=84134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 01:28:29 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:28:29 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=1 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:28:29 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Acquiring lock "cinder-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:28:29 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "cinder-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:28:30 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:28:30 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Acquiring lock "cinder-quobyte-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:28:30 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "cinder-quobyte-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd" acquired by "delete_volume" :: waited 0.013s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:28:30 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02f167d-82be-4782-b6b6-29a9a64a766c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:28:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd" returned: 0 in 0.385s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd" returned: 0 in 0.097s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:30 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "cinder-quobyte-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd" released by "delete_volume" :: held 0.624s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:28:30 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Created reservations ['37d0a57e-39e7-4328-8b94-c00dd05eb113', '2a15e59b-c68c-45a0-900d-82fb332bc3d3', '0ee4a842-bd94-4c9c-a9af-609cbb3258aa', '92472566-1932-4896-8246-cfb7ee140f97'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Acquiring lock "cinder-5a0e0a2c-2777-4f89-9d8f-ed401ff95760-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.294s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "cinder-5a0e0a2c-2777-4f89-9d8f-ed401ff95760-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:28:31 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Deleted volume successfully.
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a6625568-75ca-49f3-a2d8-3612654aa68d tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "cinder-0b4bc5db-7820-4e78-b1fd-1329d4bfffcd-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:28:31 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Acquiring lock "cinder-quobyte-5a0e0a2c-2777-4f89-9d8f-ed401ff95760" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "cinder-quobyte-5a0e0a2c-2777-4f89-9d8f-ed401ff95760" acquired by "delete_volume" :: waited 0.013s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc36230a-8aac-4e70-ae28-89252060cfe2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:28:31 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760" returned: 0 in 0.382s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-5a0e0a2c-2777-4f89-9d8f-ed401ff95760" returned: 0 in 0.096s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:32 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "cinder-quobyte-5a0e0a2c-2777-4f89-9d8f-ed401ff95760" released by "delete_volume" :: held 0.623s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:28:32 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Created reservations ['263f0e54-5db4-498d-a8db-430fcfea46f4', 'db21121d-56f3-49aa-a794-35a62eb8c6fb', '4134fb10-717d-480f-ae77-9b5d7653b995', '60b06465-c3d4-464b-b1ab-decc417e6fef'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:28:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:32 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:28:32 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:28:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:32 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.098s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:32 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:28:32 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Deleted volume successfully.
Sep 18 01:28:33 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e0e02883-b3d6-4c19-bf22-aef467fee0f3 tempest-TestServerVolumeAttachmentScenario-58157792 None] Lock "cinder-5a0e0a2c-2777-4f89-9d8f-ed401ff95760-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:28:42 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=15,cinder:SELECT=9,cinder:INSERT=6 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:28:42 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:28:46 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:28:46 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Flow 'volume_create_manager' (02e00dd5-7c83-476c-b9bd-4b2d411f789b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6576de-648c-473e-b0b5-43a9e5a816fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6576de-648c-473e-b0b5-43a9e5a816fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2109700614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e821c6-5c5c-4dd6-8721-8273c42492ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68eabd13f9446308645dfc8d2e1c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:28:47Z,use_quota=True,user_id='e0c4125976f843dba59b6afd43e2b052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184db915-9302-4e0c-a430-1889e71c6a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184db915-9302-4e0c-a430-1889e71c6a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5db05a-db47-4897-ba9a-acf855eb7b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5db05a-db47-4897-ba9a-acf855eb7b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3e821c6-5c5c-4dd6-8721-8273c42492ed', 'volume_name': 'volume-e3e821c6-5c5c-4dd6-8721-8273c42492ed', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e122ee54-a637-4b27-8949-1bef1415bd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e122ee54-a637-4b27-8949-1bef1415bd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93aa1fd6-10ae-44b8-a928-a9ede78c732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:47 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume e3e821c6-5c5c-4dd6-8721-8273c42492ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3e821c6-5c5c-4dd6-8721-8273c42492ed', 'volume_size': 1}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2109700614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e821c6-5c5c-4dd6-8721-8273c42492ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68eabd13f9446308645dfc8d2e1c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:28:47Z,use_quota=True,user_id='e0c4125976f843dba59b6afd43e2b052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Creating volume e3e821c6-5c5c-4dd6-8721-8273c42492ed {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:28:47 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e3e821c6-5c5c-4dd6-8721-8273c42492ed 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:47 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=139, name=volume-e3e821c6-5c5c-4dd6-8721-8273c42492ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e3e821c6-5c5c-4dd6-8721-8273c42492ed 1073741824" returned: 0 in 0.302s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e3e821c6-5c5c-4dd6-8721-8273c42492ed {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e3e821c6-5c5c-4dd6-8721-8273c42492ed" returned: 0 in 0.082s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] <== create_volume: return (454ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.466s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93aa1fd6-10ae-44b8-a928-a9ede78c732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e821c6-5c5c-4dd6-8721-8273c42492ed', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c07a5e-2035-4a2b-b814-50075f73f7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:47 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume volume-e3e821c6-5c5c-4dd6-8721-8273c42492ed (e3e821c6-5c5c-4dd6-8721-8273c42492ed): created successfully
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c07a5e-2035-4a2b-b814-50075f73f7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Flow 'volume_create_manager' (02e00dd5-7c83-476c-b9bd-4b2d411f789b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:28:47 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e6fc2f3b-e348-40fe-8c62-76e6e2eadf0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Created volume successfully.
Sep 18 01:28:49 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Flow 'volume_create_manager' (192be4d3-fbaf-44fb-8c74-b8af38df3465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082a4862-dccd-4906-9f69-dc58aba5af36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082a4862-dccd-4906-9f69-dc58aba5af36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1105700103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4bd53f-89ad-43af-b13b-a067eb9dd276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68eabd13f9446308645dfc8d2e1c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:28:49Z,use_quota=True,user_id='e0c4125976f843dba59b6afd43e2b052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62c818f-873e-467d-8843-64a6cb6acd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62c818f-873e-467d-8843-64a6cb6acd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1c9a82-9f53-4cce-bd72-daa1c1074f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1c9a82-9f53-4cce-bd72-daa1c1074f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4bd53f-89ad-43af-b13b-a067eb9dd276', 'volume_name': 'volume-2c4bd53f-89ad-43af-b13b-a067eb9dd276', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11167e48-93ac-46d8-956d-0baa24fa9290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11167e48-93ac-46d8-956d-0baa24fa9290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d9d780-29ed-45de-9cda-415ac9cc66ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:49 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume 2c4bd53f-89ad-43af-b13b-a067eb9dd276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4bd53f-89ad-43af-b13b-a067eb9dd276', 'volume_size': 1}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1105700103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4bd53f-89ad-43af-b13b-a067eb9dd276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68eabd13f9446308645dfc8d2e1c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:28:49Z,use_quota=True,user_id='e0c4125976f843dba59b6afd43e2b052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Creating volume 2c4bd53f-89ad-43af-b13b-a067eb9dd276 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:28:49 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2c4bd53f-89ad-43af-b13b-a067eb9dd276 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:49 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=140, name=volume-2c4bd53f-89ad-43af-b13b-a067eb9dd276, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:28:49 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:28:49 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Flow 'volume_create_manager' (c8be16b4-bdf9-4c0d-b8b3-2f04da3ce1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024fad65-f955-4d00-b5ed-9aa26cd137bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2c4bd53f-89ad-43af-b13b-a067eb9dd276 1073741824" returned: 0 in 0.638s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2c4bd53f-89ad-43af-b13b-a067eb9dd276 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024fad65-f955-4d00-b5ed-9aa26cd137bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-34033211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68eabd13f9446308645dfc8d2e1c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:28:50Z,use_quota=True,user_id='e0c4125976f843dba59b6afd43e2b052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c6a1a2-9265-425f-aa3a-5e427432c16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c6a1a2-9265-425f-aa3a-5e427432c16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d13901-555d-4a00-af57-288d4b51636d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d13901-555d-4a00-af57-288d4b51636d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9', 'volume_name': 'volume-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e39db5b-d42a-4b8d-be08-9e7ad2349c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e39db5b-d42a-4b8d-be08-9e7ad2349c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce20de79-b45c-49f4-b957-d677b64de1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:50 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume 9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9', 'volume_size': 1}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:50 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Flow 'volume_create_manager' (a9b03afb-e1f9-4323-8592-5646710ce580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0e6e08-30ff-463d-b7e7-1d9d0e684e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2c4bd53f-89ad-43af-b13b-a067eb9dd276" returned: 0 in 0.567s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0e6e08-30ff-463d-b7e7-1d9d0e684e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185755531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b17a45-3b20-4522-96c1-d9cdfefb153b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68eabd13f9446308645dfc8d2e1c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:28:50Z,use_quota=True,user_id='e0c4125976f843dba59b6afd43e2b052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9a1883-3815-4d33-957f-92b948aec041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9a1883-3815-4d33-957f-92b948aec041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8674050-0f52-45cc-b443-b87919d21bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8674050-0f52-45cc-b443-b87919d21bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b17a45-3b20-4522-96c1-d9cdfefb153b', 'volume_name': 'volume-29b17a45-3b20-4522-96c1-d9cdfefb153b', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b88a0381-ba4a-4ce2-8d4a-f6407359411b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b88a0381-ba4a-4ce2-8d4a-f6407359411b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44ba3e1-c2e7-4fa4-8e3b-82c145157016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:50 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume 29b17a45-3b20-4522-96c1-d9cdfefb153b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b17a45-3b20-4522-96c1-d9cdfefb153b', 'volume_size': 1}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] <== create_volume: return (1285ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-34033211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68eabd13f9446308645dfc8d2e1c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:28:50Z,use_quota=True,user_id='e0c4125976f843dba59b6afd43e2b052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Creating volume 9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:28:50 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:28:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:50 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=141, name=volume-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:28:51 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Flow 'volume_create_manager' (21833b3f-16a2-46fa-926a-85dc019f669a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5816635c-c1ad-4cdf-8030-4e9d619d903c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d9d780-29ed-45de-9cda-415ac9cc66ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4bd53f-89ad-43af-b13b-a067eb9dd276', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23afc10f-e2fd-419a-b393-d0c3abe4024f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9 1073741824" returned: 0 in 0.828s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5816635c-c1ad-4cdf-8030-4e9d619d903c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-118933706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bf0268-5502-4568-ba27-8241e0e2bb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68eabd13f9446308645dfc8d2e1c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:28:50Z,use_quota=True,user_id='e0c4125976f843dba59b6afd43e2b052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc961fc-b08c-4603-98ce-549018484eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc961fc-b08c-4603-98ce-549018484eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8b3c25-054a-4887-b5a5-2851644c1711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8b3c25-054a-4887-b5a5-2851644c1711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82bf0268-5502-4568-ba27-8241e0e2bb43', 'volume_name': 'volume-82bf0268-5502-4568-ba27-8241e0e2bb43', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e55db10-27bf-43ef-b9a2-3aca43f491ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e55db10-27bf-43ef-b9a2-3aca43f491ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b2c47f-9436-41cd-a818-6abb5200a8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:51 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume 82bf0268-5502-4568-ba27-8241e0e2bb43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82bf0268-5502-4568-ba27-8241e0e2bb43', 'volume_size': 1}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:51 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume volume-2c4bd53f-89ad-43af-b13b-a067eb9dd276 (2c4bd53f-89ad-43af-b13b-a067eb9dd276): created successfully
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23afc10f-e2fd-419a-b393-d0c3abe4024f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Flow 'volume_create_manager' (192be4d3-fbaf-44fb-8c74-b8af38df3465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:28:52 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Flow 'volume_create_manager' (66b9b797-6bb5-4ecb-a562-400cc5370e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414a8e73-2c22-4743-8783-2c26da1eb7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9" returned: 0 in 0.495s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] <== create_volume: return (1374ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.405s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185755531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b17a45-3b20-4522-96c1-d9cdfefb153b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68eabd13f9446308645dfc8d2e1c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:28:50Z,use_quota=True,user_id='e0c4125976f843dba59b6afd43e2b052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Creating volume 29b17a45-3b20-4522-96c1-d9cdfefb153b {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:28:52 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-29b17a45-3b20-4522-96c1-d9cdfefb153b 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:52 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=142, name=volume-29b17a45-3b20-4522-96c1-d9cdfefb153b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414a8e73-2c22-4743-8783-2c26da1eb7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1931341057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63159d9-c977-40a3-9728-61e565cc196d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68eabd13f9446308645dfc8d2e1c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:28:51Z,use_quota=True,user_id='e0c4125976f843dba59b6afd43e2b052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac77d964-dab1-432d-8b36-42ced42f5c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac77d964-dab1-432d-8b36-42ced42f5c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3b8d1b-ba5c-4d49-9c3c-05b990b7fbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3b8d1b-ba5c-4d49-9c3c-05b990b7fbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63159d9-c977-40a3-9728-61e565cc196d', 'volume_name': 'volume-d63159d9-c977-40a3-9728-61e565cc196d', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b75481a-afef-4a6c-ba78-e155390dd16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b75481a-afef-4a6c-ba78-e155390dd16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82a1b67-622e-4934-a8ba-58a61ae60d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:52 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume d63159d9-c977-40a3-9728-61e565cc196d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63159d9-c977-40a3-9728-61e565cc196d', 'volume_size': 1}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:52 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-f6b03f4a-ad12-4e77-ab31-f88bf4029bc3 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Created volume successfully.
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce20de79-b45c-49f4-b957-d677b64de1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2b8ed8-9445-4f43-963a-fa8bbc9ba107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-29b17a45-3b20-4522-96c1-d9cdfefb153b 1073741824" returned: 0 in 0.463s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-29b17a45-3b20-4522-96c1-d9cdfefb153b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:52 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume volume-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9 (9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9): created successfully
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2b8ed8-9445-4f43-963a-fa8bbc9ba107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Flow 'volume_create_manager' (c8be16b4-bdf9-4c0d-b8b3-2f04da3ce1a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-29b17a45-3b20-4522-96c1-d9cdfefb153b" returned: 0 in 0.334s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] <== create_volume: return (818ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:28:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.364s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-118933706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bf0268-5502-4568-ba27-8241e0e2bb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68eabd13f9446308645dfc8d2e1c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:28:50Z,use_quota=True,user_id='e0c4125976f843dba59b6afd43e2b052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Creating volume 82bf0268-5502-4568-ba27-8241e0e2bb43 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:28:53 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-82bf0268-5502-4568-ba27-8241e0e2bb43 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:53 devstack quobyte-client[84147]: System call of process 101056 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:28:53 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=143, name=volume-82bf0268-5502-4568-ba27-8241e0e2bb43, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:28:53 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3b501737-ca4b-4afb-bf9f-92f6916c8e0e tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Created volume successfully.
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44ba3e1-c2e7-4fa4-8e3b-82c145157016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b17a45-3b20-4522-96c1-d9cdfefb153b', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3b847a-2b60-43c6-9606-1c56eb4fc4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-82bf0268-5502-4568-ba27-8241e0e2bb43 1073741824" returned: 0 in 0.469s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-82bf0268-5502-4568-ba27-8241e0e2bb43 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:53 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume volume-29b17a45-3b20-4522-96c1-d9cdfefb153b (29b17a45-3b20-4522-96c1-d9cdfefb153b): created successfully
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3b847a-2b60-43c6-9606-1c56eb4fc4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Flow 'volume_create_manager' (a9b03afb-e1f9-4323-8592-5646710ce580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-82bf0268-5502-4568-ba27-8241e0e2bb43" returned: 0 in 0.298s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] <== create_volume: return (793ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.339s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1931341057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63159d9-c977-40a3-9728-61e565cc196d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68eabd13f9446308645dfc8d2e1c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:28:51Z,use_quota=True,user_id='e0c4125976f843dba59b6afd43e2b052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Creating volume d63159d9-c977-40a3-9728-61e565cc196d {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:28:53 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:28:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d63159d9-c977-40a3-9728-61e565cc196d 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:54 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=144, name=volume-d63159d9-c977-40a3-9728-61e565cc196d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:28:54 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-602772c4-5168-4961-9f13-3e10a42276d7 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Created volume successfully.
Sep 18 01:28:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b2c47f-9436-41cd-a818-6abb5200a8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82bf0268-5502-4568-ba27-8241e0e2bb43', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d65750-833b-4341-8ac5-cf6773fe5d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d63159d9-c977-40a3-9728-61e565cc196d 1073741824" returned: 0 in 0.446s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:54 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume volume-82bf0268-5502-4568-ba27-8241e0e2bb43 (82bf0268-5502-4568-ba27-8241e0e2bb43): created successfully
Sep 18 01:28:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d65750-833b-4341-8ac5-cf6773fe5d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Flow 'volume_create_manager' (21833b3f-16a2-46fa-926a-85dc019f669a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:28:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d63159d9-c977-40a3-9728-61e565cc196d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:54 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-11140851-6009-4d50-a27b-b2d7d7e54b07 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Created volume successfully.
Sep 18 01:28:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d63159d9-c977-40a3-9728-61e565cc196d" returned: 0 in 0.342s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] <== create_volume: return (841ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:28:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82a1b67-622e-4934-a8ba-58a61ae60d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63159d9-c977-40a3-9728-61e565cc196d', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36ce9fd-9ca2-402f-af3e-739367f827cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:28:54 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume volume-d63159d9-c977-40a3-9728-61e565cc196d (d63159d9-c977-40a3-9728-61e565cc196d): created successfully
Sep 18 01:28:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36ce9fd-9ca2-402f-af3e-739367f827cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:28:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Flow 'volume_create_manager' (66b9b797-6bb5-4ecb-a562-400cc5370e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:28:54 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-0eac4e37-622a-4b57-acd0-7e3bd86340f4 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Created volume successfully.
Sep 18 01:28:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "cinder-d63159d9-c977-40a3-9728-61e565cc196d-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:28:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-d63159d9-c977-40a3-9728-61e565cc196d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:28:55 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:28:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "cinder-quobyte-d63159d9-c977-40a3-9728-61e565cc196d" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:28:55 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-quobyte-d63159d9-c977-40a3-9728-61e565cc196d" acquired by "delete_volume" :: waited 0.016s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:28:55 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b1c3f4-8b9e-425a-8e7c-f293d6c64a20]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:28:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d63159d9-c977-40a3-9728-61e565cc196d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d63159d9-c977-40a3-9728-61e565cc196d" returned: 0 in 0.407s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d63159d9-c977-40a3-9728-61e565cc196d {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-d63159d9-c977-40a3-9728-61e565cc196d" returned: 0 in 0.085s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-quobyte-d63159d9-c977-40a3-9728-61e565cc196d" released by "delete_volume" :: held 0.653s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:28:56 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Created reservations ['7ca5a786-cf3e-4804-9bf4-b1f805c75c14', '1427d881-f4ac-4451-94c9-87ebb2f1a20d', 'ab8988d4-0922-44e2-80b9-c1a66813fe0d', 'efeebea0-28e3-4250-a8b1-66719890d2d1'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:28:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:28:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:28:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.084s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:28:57 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Deleted volume successfully.
Sep 18 01:28:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-20efdc80-64d8-434a-b177-8e894d8768ba tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-d63159d9-c977-40a3-9728-61e565cc196d-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:28:57 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:28:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:28:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:28:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.131s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:28:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "cinder-82bf0268-5502-4568-ba27-8241e0e2bb43-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:28:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-82bf0268-5502-4568-ba27-8241e0e2bb43-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:28:58 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:28:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "cinder-quobyte-82bf0268-5502-4568-ba27-8241e0e2bb43" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:28:58 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-quobyte-82bf0268-5502-4568-ba27-8241e0e2bb43" acquired by "delete_volume" :: waited 0.021s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:28:58 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ce1fb8-c32c-4f9b-a0d9-47995af54178]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:28:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-82bf0268-5502-4568-ba27-8241e0e2bb43 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-82bf0268-5502-4568-ba27-8241e0e2bb43" returned: 0 in 0.385s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-82bf0268-5502-4568-ba27-8241e0e2bb43 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-82bf0268-5502-4568-ba27-8241e0e2bb43" returned: 0 in 0.085s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-quobyte-82bf0268-5502-4568-ba27-8241e0e2bb43" released by "delete_volume" :: held 0.632s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:28:59 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Created reservations ['1aa2869d-4554-441c-b5b8-98f77c9c8dd6', '93f4ec34-2424-4768-8196-c0373ae1e552', '4db8763c-63ee-4019-8348-be1775c8574e', '1697ee88-b9e7-4119-9a23-d12f35047a52'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:28:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:28:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:28:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:28:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:28:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:28:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:28:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.085s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:28:59 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:28:59 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Deleted volume successfully.
Sep 18 01:28:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-725e9188-8d63-4dbe-9f68-fa8180bf9076 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-82bf0268-5502-4568-ba27-8241e0e2bb43-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:29:00 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "cinder-29b17a45-3b20-4522-96c1-d9cdfefb153b-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:29:00 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-29b17a45-3b20-4522-96c1-d9cdfefb153b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:29:00 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:00 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "cinder-quobyte-29b17a45-3b20-4522-96c1-d9cdfefb153b" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:29:00 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-quobyte-29b17a45-3b20-4522-96c1-d9cdfefb153b" acquired by "delete_volume" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:29:00 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d5c593-5ec4-47d6-98fb-64f281f852f2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:29:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-29b17a45-3b20-4522-96c1-d9cdfefb153b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-29b17a45-3b20-4522-96c1-d9cdfefb153b" returned: 0 in 0.397s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-29b17a45-3b20-4522-96c1-d9cdfefb153b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-29b17a45-3b20-4522-96c1-d9cdfefb153b" returned: 0 in 0.111s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-quobyte-29b17a45-3b20-4522-96c1-d9cdfefb153b" released by "delete_volume" :: held 0.666s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:29:01 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Created reservations ['eec13143-3083-4195-8ba5-cac27bcff8b5', '1f019589-6f06-4c24-abec-afd7ea87d5b4', '872f1728-f137-472a-af4b-a6978d393544', '9fd00649-5f20-40b6-9526-f40cccf6c158'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:29:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.084s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:01 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:29:01 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Deleted volume successfully.
Sep 18 01:29:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e55e1e64-43c5-4235-940b-064a27a2fa03 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-29b17a45-3b20-4522-96c1-d9cdfefb153b-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:29:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "cinder-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:29:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:29:02 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "cinder-quobyte-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:29:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-quobyte-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9" acquired by "delete_volume" :: waited 0.010s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:29:02 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b467ae6-d144-461d-b494-705495c13632]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:29:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9" returned: 0 in 0.380s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9" returned: 0 in 0.121s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-quobyte-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9" released by "delete_volume" :: held 0.659s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:29:03 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Created reservations ['714037b3-2b64-4791-b441-396e44eecd79', 'ea33c123-8440-446b-935f-9f3dadecc9e4', '8e243461-83c2-4623-b985-ee0821dad1ff', '256c3673-8624-47f7-84aa-77f22bd8c7ae'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:29:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.115s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:03 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:29:04 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Deleted volume successfully.
Sep 18 01:29:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-a4fa58c4-4dce-4632-91aa-7b4f85607ce1 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-9f46bcd5-2156-4e3c-8b83-ec9f039ea5a9-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:29:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "cinder-2c4bd53f-89ad-43af-b13b-a067eb9dd276-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:29:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-2c4bd53f-89ad-43af-b13b-a067eb9dd276-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:29:04 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:04 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "cinder-quobyte-2c4bd53f-89ad-43af-b13b-a067eb9dd276" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:29:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-quobyte-2c4bd53f-89ad-43af-b13b-a067eb9dd276" acquired by "delete_volume" :: waited 0.010s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:29:05 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[db973508-dfa4-4c61-82bd-912d33bc6127]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:29:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2c4bd53f-89ad-43af-b13b-a067eb9dd276 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2c4bd53f-89ad-43af-b13b-a067eb9dd276" returned: 0 in 0.376s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2c4bd53f-89ad-43af-b13b-a067eb9dd276 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-2c4bd53f-89ad-43af-b13b-a067eb9dd276" returned: 0 in 0.119s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-quobyte-2c4bd53f-89ad-43af-b13b-a067eb9dd276" released by "delete_volume" :: held 0.651s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:29:05 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Created reservations ['1072276c-38e0-4edb-a275-5e018eb3691e', '58176c2e-66b4-4812-b1ca-78acd3703d90', 'f86e52d3-dcf4-4f05-8827-bd19012f33e4', '1c4b4c96-db47-46b0-8b52-94c4c4a7d155'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:29:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:06 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:06 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.119s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:06 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:29:06 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Deleted volume successfully.
Sep 18 01:29:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5ae498a1-dd12-4911-8722-1c9e90a1c778 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-2c4bd53f-89ad-43af-b13b-a067eb9dd276-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:29:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "cinder-e3e821c6-5c5c-4dd6-8721-8273c42492ed-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:29:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-e3e821c6-5c5c-4dd6-8721-8273c42492ed-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:29:07 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "cinder-quobyte-e3e821c6-5c5c-4dd6-8721-8273c42492ed" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:29:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-quobyte-e3e821c6-5c5c-4dd6-8721-8273c42492ed" acquired by "delete_volume" :: waited 0.013s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:29:07 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f05a1d-679b-483b-9700-23b722f6d171]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:29:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e3e821c6-5c5c-4dd6-8721-8273c42492ed {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e3e821c6-5c5c-4dd6-8721-8273c42492ed" returned: 0 in 0.383s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e3e821c6-5c5c-4dd6-8721-8273c42492ed {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-e3e821c6-5c5c-4dd6-8721-8273c42492ed" returned: 0 in 0.104s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-quobyte-e3e821c6-5c5c-4dd6-8721-8273c42492ed" released by "delete_volume" :: held 0.630s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:29:08 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Created reservations ['6bf40b55-2090-4bf5-95e3-0166d8441133', '8325aa62-433e-4c43-9575-601bd4ce4eb1', 'eaea6828-450d-4f9d-8aa9-67f33a3e2abd', '96447381-fac1-4949-b762-29beec93cdd5'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:29:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:08 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:08 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.104s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:08 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:29:08 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Deleted volume successfully.
Sep 18 01:29:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-407c2038-cdc1-41bc-b5fe-334fb0457235 tempest-CreateVolumesFromSourceVolumeTest-1249584869 None] Lock "cinder-e3e821c6-5c5c-4dd6-8721-8273c42492ed-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:29:14 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Flow 'volume_create_manager' (f33f668a-082c-40a0-b9d6-877a00b371df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53895a2-2aac-4ccb-b755-6e32106fca29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53895a2-2aac-4ccb-b755-6e32106fca29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a0bab3c-ca57-4076-a919-95c4ac65a27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684e8ccfd1f04397a388aef80c95ec76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:14Z,use_quota=True,user_id='806eae1dcfe74ddca7ef19a3e0b9535b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21973ed7-1464-4f55-9687-ed01adf59314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21973ed7-1464-4f55-9687-ed01adf59314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88596f71-d034-49a8-aae8-36b7232226ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG cinder.image.glance [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Creating Keystone auth plugin from conf {{(pid=84134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88596f71-d034-49a8-aae8-36b7232226ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9a0bab3c-ca57-4076-a919-95c4ac65a27f', 'volume_name': 'volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f', 'volume_size': 1, 'image_id': 'bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '244a5741a54a0f4d9016527a6e5fc98f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '684e8ccfd1f04397a388aef80c95ec76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a09c8f8f9db8daaa002c64b40c9bccecd722d6b9561d467b46e5acb721fbec6baa38ff26a1d246645d2a6237cee707c68b265d904e09e6e26fd71239f67976f', 'id': 'bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e', 'created_at': datetime.datetime(2025, 9, 17, 23, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 23, 29, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a682a500>}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6e6830-a5a2-4843-adb2-2775381aca42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6e6830-a5a2-4843-adb2-2775381aca42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9897ce-778e-4cc1-b06c-adfd34a63c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:14 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Volume 9a0bab3c-ca57-4076-a919-95c4ac65a27f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f', 'volume_size': 1, 'image_id': 'bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '244a5741a54a0f4d9016527a6e5fc98f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '684e8ccfd1f04397a388aef80c95ec76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a09c8f8f9db8daaa002c64b40c9bccecd722d6b9561d467b46e5acb721fbec6baa38ff26a1d246645d2a6237cee707c68b265d904e09e6e26fd71239f67976f', 'id': 'bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e', 'created_at': datetime.datetime(2025, 9, 17, 23, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 23, 29, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a682a500>}
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Cloning 9a0bab3c-ca57-4076-a919-95c4ac65a27f from image bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e  at location (None, [{'url': 'file:///opt/stack/data/glance/images/bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e', 'metadata': {}}]). {{(pid=84134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 01:29:14 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Image download 0.00 MB at 0.00 MB/s
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c364f85-75aa-47dd-8b23-100dece8c3c9]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:29:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:15 devstack sudo[101102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD
Sep 18 01:29:15 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:29:16 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root
Sep 18 01:29:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD" returned: 0 in 2.017s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:17 devstack sudo[101106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD
Sep 18 01:29:17 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:29:18 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root
Sep 18 01:29:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD" returned: 1 in 1.867s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:29:18 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Temporary image bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e is fetched for user 806eae1dcfe74ddca7ef19a3e0b9535b. {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 01:29:18 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f58ae4-1d5d-45f7-8c6a-680c0988fe46]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:29:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:19 devstack sudo[101111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD
Sep 18 01:29:19 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:29:20 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root
Sep 18 01:29:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD" returned: 0 in 1.881s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:21 devstack sudo[101115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD
Sep 18 01:29:21 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:29:22 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root
Sep 18 01:29:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD" returned: 1 in 1.835s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:29:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:22 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a0bab3c-ca57-4076-a919-95c4ac65a27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684e8ccfd1f04397a388aef80c95ec76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:14Z,use_quota=True,user_id='806eae1dcfe74ddca7ef19a3e0b9535b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:29:22 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Creating volume 9a0bab3c-ca57-4076-a919-95c4ac65a27f {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:29:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:22 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:22 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:22 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:29:22 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:29:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:22 devstack quobyte-client[84147]: System call of process 101120 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:29:22 devstack quobyte-client[84147]: System call of process 101120 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:29:22 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=145, name=volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:29:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f 1073741824" returned: 0 in 0.351s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f" returned: 0 in 0.089s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] <== create_volume: return (531ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:29:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.567s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:23 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Attempting download of bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e ((None, [{'url': 'file:///opt/stack/data/glance/images/bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e', 'metadata': {}}])) to volume 9a0bab3c-ca57-4076-a919-95c4ac65a27f. {{(pid=84134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 01:29:23 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e69d429-acf5-4223-a3cc-9b9e0f8b1730]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:29:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_iqx42y0i {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_iqx42y0i" returned: 0 in 0.336s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_iqx42y0i {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_iqx42y0i" returned: 1 in 0.351s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_iqx42y0i' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:29:24 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c3b92d-ec18-4145-b54e-cc849d7a7112]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:29:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD" returned: 1 in 0.333s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:29:25 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e was raw, converting to raw {{(pid=84134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 01:29:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:25 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=145, name=volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:29:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f" returned: 0 in 0.136s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:25 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e_v_z5k192devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f {{(pid=84134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 01:29:25 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Converted 0.00 MB image at 0.00 MB/s
Sep 18 01:29:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f 1G" returned: 0 in 0.114s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:25 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e082f6-3eb1-40b6-91f8-f616b8549cee]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:29:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f" returned: 0 in 0.356s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f" returned: 1 in 0.331s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:29:26 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Downloaded image bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e ((None, [{'url': 'file:///opt/stack/data/glance/images/bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e', 'metadata': {}}])) to volume 9a0bab3c-ca57-4076-a919-95c4ac65a27f successfully. {{(pid=84134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 01:29:26 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Temporary image bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e for user 806eae1dcfe74ddca7ef19a3e0b9535b is deleted. {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 01:29:26 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Marking volume 9a0bab3c-ca57-4076-a919-95c4ac65a27f as bootable. {{(pid=84134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 01:29:26 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Copying metadata from image bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e to 9a0bab3c-ca57-4076-a919-95c4ac65a27f. {{(pid=84134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 01:29:26 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Creating volume glance metadata for volume 9a0bab3c-ca57-4076-a919-95c4ac65a27f backed by image bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e with: {'image_id': 'bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '244a5741a54a0f4d9016527a6e5fc98f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 01:29:26 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9897ce-778e-4cc1-b06c-adfd34a63c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f', 'volume_size': 1, 'image_id': 'bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '244a5741a54a0f4d9016527a6e5fc98f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '684e8ccfd1f04397a388aef80c95ec76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a09c8f8f9db8daaa002c64b40c9bccecd722d6b9561d467b46e5acb721fbec6baa38ff26a1d246645d2a6237cee707c68b265d904e09e6e26fd71239f67976f', 'id': 'bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e', 'created_at': datetime.datetime(2025, 9, 17, 23, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 23, 29, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfccd32c-3ce1-4e60-8ad2-6a8ee5a93c8e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a682a500>}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:26 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87456ce-f95b-403b-8344-7d0702881d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:26 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Volume volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f (9a0bab3c-ca57-4076-a919-95c4ac65a27f): created successfully
Sep 18 01:29:26 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87456ce-f95b-403b-8344-7d0702881d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:26 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Flow 'volume_create_manager' (f33f668a-082c-40a0-b9d6-877a00b371df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:26 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-6dcf35b4-55b6-4d40-9ef2-c79478ec6c7a tempest-VolumeImageDependencyTests-990762579 None] Created volume successfully.
Sep 18 01:29:27 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Acquiring lock "cinder-9a0bab3c-ca57-4076-a919-95c4ac65a27f-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:29:27 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Lock "cinder-9a0bab3c-ca57-4076-a919-95c4ac65a27f-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:29:27 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:27 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Acquiring lock "cinder-quobyte-9a0bab3c-ca57-4076-a919-95c4ac65a27f" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:29:27 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Lock "cinder-quobyte-9a0bab3c-ca57-4076-a919-95c4ac65a27f" acquired by "delete_volume" :: waited 0.013s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:29:27 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffcd7e8-2b24-4ca0-a0d6-a84d59082284]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:29:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f" returned: 0 in 0.488s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f" returned: 1 in 0.401s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:29:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-9a0bab3c-ca57-4076-a919-95c4ac65a27f" returned: 0 in 0.083s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:28 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Lock "cinder-quobyte-9a0bab3c-ca57-4076-a919-95c4ac65a27f" released by "delete_volume" :: held 1.232s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:29:28 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Created reservations ['883c058b-7d12-4f27-8926-f7bd5c131ba5', '63087e61-1cd4-42f5-a977-b6985a75c4b8', '5d243d84-8daf-439e-9e7a-4ca41cbef3f7', '48b65abf-e8f9-4079-97d3-ff1c854cee2e'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:29:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.085s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:29 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:29:29 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Deleted volume successfully.
Sep 18 01:29:29 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-cf0dccb7-2a17-4575-ae81-bcf566e1a921 tempest-VolumeImageDependencyTests-990762579 None] Lock "cinder-9a0bab3c-ca57-4076-a919-95c4ac65a27f-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:29:38 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=59,cinder:SELECT=44,cinder:DELETE=9,cinder:INSERT=16 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:29:39 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=52,cinder:UPDATE=85,cinder:DELETE=5,cinder:INSERT=21 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:29:46 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Flow 'volume_create_manager' (7970058a-a152-4519-af40-d8ed9bb78afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca27abf-0675-4fb7-9fdd-c527091f8282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca27abf-0675-4fb7-9fdd-c527091f8282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1023921595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496cf8ca-d6e5-41ad-a902-2583d4faa7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f81450e62914f05904f213b9687adea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:46Z,use_quota=True,user_id='a727bf52e4ad491bb130afec0910a2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a522665-d9b7-46aa-9221-615275263f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a522665-d9b7-46aa-9221-615275263f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3cc085-1ba6-4f57-a302-071c12ba6d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3cc085-1ba6-4f57-a302-071c12ba6d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '496cf8ca-d6e5-41ad-a902-2583d4faa7ec', 'volume_name': 'volume-496cf8ca-d6e5-41ad-a902-2583d4faa7ec', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ece30f-50a0-45bb-825d-8479cace1551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ece30f-50a0-45bb-825d-8479cace1551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21e2e5d-5b41-4aef-81f5-e56bc0515cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:46 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume 496cf8ca-d6e5-41ad-a902-2583d4faa7ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-496cf8ca-d6e5-41ad-a902-2583d4faa7ec', 'volume_size': 1}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1023921595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496cf8ca-d6e5-41ad-a902-2583d4faa7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f81450e62914f05904f213b9687adea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:46Z,use_quota=True,user_id='a727bf52e4ad491bb130afec0910a2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Creating volume 496cf8ca-d6e5-41ad-a902-2583d4faa7ec {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:29:46 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:29:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-496cf8ca-d6e5-41ad-a902-2583d4faa7ec 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:47 devstack quobyte-client[84147]: System call of process 101238 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:29:47 devstack quobyte-client[84147]: System call of process 101238 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:29:47 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=146, name=volume-496cf8ca-d6e5-41ad-a902-2583d4faa7ec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:29:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-496cf8ca-d6e5-41ad-a902-2583d4faa7ec 1073741824" returned: 0 in 0.705s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-496cf8ca-d6e5-41ad-a902-2583d4faa7ec {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:47 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:47 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:29:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Flow 'volume_create_manager' (4047e782-640a-4ca9-8f6b-d4c96cef52f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:47 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9a0166-9ca3-4a50-9d43-7569696a11c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9a0166-9ca3-4a50-9d43-7569696a11c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c487c8-9845-4184-9761-a727e6e77303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63f4955a3a8549b6ac0863fe36632f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:47Z,use_quota=True,user_id='070b6679f97047b9a3145ebd73bc6fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56bf5051-ca3f-43b9-9185-3f0f134738fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56bf5051-ca3f-43b9-9185-3f0f134738fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e4d321-9b80-48e1-9ef2-625564ea8048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e4d321-9b80-48e1-9ef2-625564ea8048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62c487c8-9845-4184-9761-a727e6e77303', 'volume_name': 'volume-62c487c8-9845-4184-9761-a727e6e77303', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e011ccb-c5d3-400f-9214-c8fa9b535dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e011ccb-c5d3-400f-9214-c8fa9b535dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3e03ca-4655-48bb-8e5c-3092999ea449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Volume 62c487c8-9845-4184-9761-a727e6e77303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62c487c8-9845-4184-9761-a727e6e77303', 'volume_size': 1}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:48 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Flow 'volume_create_manager' (1a9211dc-1e63-4a28-9e57-15a2cba2d5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ae149b-adaf-4eaa-8a24-56ae7c4dd1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Flow 'volume_create_manager' (e54e04c1-b5a0-42d0-a74c-ec78736a93e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c935a63d-e041-4831-a502-f2fb619c1cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-496cf8ca-d6e5-41ad-a902-2583d4faa7ec" returned: 0 in 0.717s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:48 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Flow 'volume_create_manager' (2e1b42bb-0951-4904-9a04-46d3464759f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49ec1fc-7de5-4ad4-9071-f11f101d7d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] <== create_volume: return (1510ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49ec1fc-7de5-4ad4-9071-f11f101d7d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1265404556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9a2db9-9186-4df7-b073-096501b2d6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e768f8640641ed9d74369090ace30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:48Z,use_quota=True,user_id='23f080493c604f42a4c6d7234d198fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47f4cf3-506c-4fc1-b52d-49680bd09e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47f4cf3-506c-4fc1-b52d-49680bd09e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b377326a-db5a-467a-a98c-2c27dc6b9105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b377326a-db5a-467a-a98c-2c27dc6b9105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9a2db9-9186-4df7-b073-096501b2d6d8', 'volume_name': 'volume-0b9a2db9-9186-4df7-b073-096501b2d6d8', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e749a2-8e6d-4546-9c11-f9e81af9ca44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e749a2-8e6d-4546-9c11-f9e81af9ca44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c773b997-35c3-441e-a6fe-fafa241dbdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Volume 0b9a2db9-9186-4df7-b073-096501b2d6d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9a2db9-9186-4df7-b073-096501b2d6d8', 'volume_size': 1}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1265404556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9a2db9-9186-4df7-b073-096501b2d6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e768f8640641ed9d74369090ace30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:48Z,use_quota=True,user_id='23f080493c604f42a4c6d7234d198fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Creating volume 0b9a2db9-9186-4df7-b073-096501b2d6d8 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:29:48 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b9a2db9-9186-4df7-b073-096501b2d6d8 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:48 devstack quobyte-client[84147]: System call of process 101244 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:29:48 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=147, name=volume-0b9a2db9-9186-4df7-b073-096501b2d6d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c935a63d-e041-4831-a502-f2fb619c1cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1157184257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e768f8640641ed9d74369090ace30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:48Z,use_quota=True,user_id='23f080493c604f42a4c6d7234d198fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd77ca5f-58c1-4710-9d9b-99c686f6edaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd77ca5f-58c1-4710-9d9b-99c686f6edaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd1f1e6-14e9-4c57-aa72-4c4dbb0ceead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd1f1e6-14e9-4c57-aa72-4c4dbb0ceead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e', 'volume_name': 'volume-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23dd6dc-b4b1-40e4-9aa0-03e627f10c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23dd6dc-b4b1-40e4-9aa0-03e627f10c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e363f79a-7c35-4f29-8561-3e93ee3fb5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Volume 6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e', 'volume_size': 1}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ae149b-adaf-4eaa-8a24-56ae7c4dd1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-744567693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956f4052-3285-41a6-8a35-e545e6625aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e768f8640641ed9d74369090ace30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:47Z,use_quota=True,user_id='23f080493c604f42a4c6d7234d198fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80768c16-c1a7-45a0-a341-b00c3aa84b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80768c16-c1a7-45a0-a341-b00c3aa84b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd00ed0-2346-4507-b63b-7983a6a0607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd00ed0-2346-4507-b63b-7983a6a0607f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '956f4052-3285-41a6-8a35-e545e6625aff', 'volume_name': 'volume-956f4052-3285-41a6-8a35-e545e6625aff', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a19d80-e894-462e-980a-36c6445b28a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a19d80-e894-462e-980a-36c6445b28a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e997ef-7ab3-4979-9ebe-c5ec411d8b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Volume 956f4052-3285-41a6-8a35-e545e6625aff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-956f4052-3285-41a6-8a35-e545e6625aff', 'volume_size': 1}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21e2e5d-5b41-4aef-81f5-e56bc0515cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-496cf8ca-d6e5-41ad-a902-2583d4faa7ec', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1f85ee-8818-4762-b953-4c3201e02651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b9a2db9-9186-4df7-b073-096501b2d6d8 1073741824" returned: 0 in 0.673s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b9a2db9-9186-4df7-b073-096501b2d6d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:49 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume volume-496cf8ca-d6e5-41ad-a902-2583d4faa7ec (496cf8ca-d6e5-41ad-a902-2583d4faa7ec): created successfully
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1f85ee-8818-4762-b953-4c3201e02651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Flow 'volume_create_manager' (7970058a-a152-4519-af40-d8ed9bb78afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:49 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Flow 'volume_create_manager' (020b600f-7ff8-48e9-89b2-f288da9067b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b42aae3-5561-4d48-978c-a540807962c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:49 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Flow 'volume_create_manager' (6da3af38-9b53-482e-8ed4-6cf1734f2430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174dc616-c46b-4354-a208-9fe3da49dda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b9a2db9-9186-4df7-b073-096501b2d6d8" returned: 0 in 0.597s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b42aae3-5561-4d48-978c-a540807962c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1679746178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3fd84c1-5aac-4d1f-a225-76c790b3d4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e768f8640641ed9d74369090ace30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:48Z,use_quota=True,user_id='23f080493c604f42a4c6d7234d198fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135f50c8-e8f2-4403-88c0-bc51d270ff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135f50c8-e8f2-4403-88c0-bc51d270ff18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344d6656-3898-4245-86b5-0753ab813870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344d6656-3898-4245-86b5-0753ab813870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3fd84c1-5aac-4d1f-a225-76c790b3d4dc', 'volume_name': 'volume-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edad405d-c097-405b-a15c-de17a641a802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edad405d-c097-405b-a15c-de17a641a802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0679cc6b-a31b-4c7d-8b7a-9fb7f93010f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:49 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Volume c3fd84c1-5aac-4d1f-a225-76c790b3d4dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc', 'volume_size': 1}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] <== create_volume: return (1338ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.576s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c487c8-9845-4184-9761-a727e6e77303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63f4955a3a8549b6ac0863fe36632f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:47Z,use_quota=True,user_id='070b6679f97047b9a3145ebd73bc6fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Creating volume 62c487c8-9845-4184-9761-a727e6e77303 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:29:49 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:29:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c487c8-9845-4184-9761-a727e6e77303 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:49 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b760672b-8090-49e7-98ea-84144909c769 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Created volume successfully.
Sep 18 01:29:49 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=148, name=volume-62c487c8-9845-4184-9761-a727e6e77303, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c773b997-35c3-441e-a6fe-fafa241dbdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9a2db9-9186-4df7-b073-096501b2d6d8', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa9dd3f-f568-4d7d-9659-df8e8a80cec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174dc616-c46b-4354-a208-9fe3da49dda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1603564059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8324690f-ba7d-435e-8243-77592730b174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e768f8640641ed9d74369090ace30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:49Z,use_quota=True,user_id='23f080493c604f42a4c6d7234d198fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e587f808-cf0c-4cba-b27c-e3995248800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e587f808-cf0c-4cba-b27c-e3995248800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273c0f0c-2ee6-407b-a8e0-9faf6c0a6812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273c0f0c-2ee6-407b-a8e0-9faf6c0a6812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8324690f-ba7d-435e-8243-77592730b174', 'volume_name': 'volume-8324690f-ba7d-435e-8243-77592730b174', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb8ecce-e88f-4d23-ab46-2b16f11871bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb8ecce-e88f-4d23-ab46-2b16f11871bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae61eee-08de-4282-887d-93712cf5c690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:50 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Volume 8324690f-ba7d-435e-8243-77592730b174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8324690f-ba7d-435e-8243-77592730b174', 'volume_size': 1}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c487c8-9845-4184-9761-a727e6e77303 1073741824" returned: 0 in 0.722s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c487c8-9845-4184-9761-a727e6e77303 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:50 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Flow 'volume_create_manager' (ba9359d7-42ba-4ea7-85d2-7c3d00322518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e93f16-f3a7-48cd-b955-1ed2ec43dd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e93f16-f3a7-48cd-b955-1ed2ec43dd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-7120306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8124278c-5dd2-407c-8c19-98d1414e208f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f81450e62914f05904f213b9687adea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:50Z,use_quota=True,user_id='a727bf52e4ad491bb130afec0910a2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb27aa0-5d58-4cb2-9b0f-8c611b370ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb27aa0-5d58-4cb2-9b0f-8c611b370ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9974d0fb-d922-4e68-ad16-a3f22514290d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9974d0fb-d922-4e68-ad16-a3f22514290d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8124278c-5dd2-407c-8c19-98d1414e208f', 'volume_name': 'volume-8124278c-5dd2-407c-8c19-98d1414e208f', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a9f689-fd38-4561-8d40-15b7213ada68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a9f689-fd38-4561-8d40-15b7213ada68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:50 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d223591d-a9a8-4469-9723-60956b0d37d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:50 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume 8124278c-5dd2-407c-8c19-98d1414e208f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8124278c-5dd2-407c-8c19-98d1414e208f', 'volume_size': 1}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:51 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Flow 'volume_create_manager' (49b2015e-0352-4aab-8663-3ebcd35a9138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cd1c7b-276c-4bb2-97c2-5e71484b52da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:51 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Volume volume-0b9a2db9-9186-4df7-b073-096501b2d6d8 (0b9a2db9-9186-4df7-b073-096501b2d6d8): created successfully
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa9dd3f-f568-4d7d-9659-df8e8a80cec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Flow 'volume_create_manager' (2e1b42bb-0951-4904-9a04-46d3464759f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c487c8-9845-4184-9761-a727e6e77303" returned: 0 in 0.744s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:51 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-ee385f94-b765-4b99-9f70-ae3a02ee68f3 tempest-CreateVolumesFromImageTest-1443773779 None] Created volume successfully.
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] <== create_volume: return (1494ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.454s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1157184257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e768f8640641ed9d74369090ace30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:48Z,use_quota=True,user_id='23f080493c604f42a4c6d7234d198fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Creating volume 6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:29:51 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:51 devstack quobyte-client[84147]: System call of process 101252 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:29:51 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=149, name=volume-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cd1c7b-276c-4bb2-97c2-5e71484b52da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-666039585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5093ac6-37b5-4ac9-9e2a-160090db3367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f81450e62914f05904f213b9687adea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:50Z,use_quota=True,user_id='a727bf52e4ad491bb130afec0910a2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6605bc35-b448-4e1c-a481-200da3addef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6605bc35-b448-4e1c-a481-200da3addef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c5d126-5f23-470c-a6f6-028de31fddff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c5d126-5f23-470c-a6f6-028de31fddff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5093ac6-37b5-4ac9-9e2a-160090db3367', 'volume_name': 'volume-b5093ac6-37b5-4ac9-9e2a-160090db3367', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83fd3a3-5a01-4c0f-a6b5-aae1d4ca1e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83fd3a3-5a01-4c0f-a6b5-aae1d4ca1e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5745b43e-1985-40b8-9728-b7e72fa93005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:51 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume b5093ac6-37b5-4ac9-9e2a-160090db3367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5093ac6-37b5-4ac9-9e2a-160090db3367', 'volume_size': 1}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3e03ca-4655-48bb-8e5c-3092999ea449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c487c8-9845-4184-9761-a727e6e77303', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580212d3-b9fc-42cc-810c-d007f699d4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:51 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Flow 'volume_create_manager' (1dacb466-db5a-4e13-a78c-21b4d1173b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513e0ceb-421c-46e2-9e3c-7df3168ac508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:51 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Volume volume-62c487c8-9845-4184-9761-a727e6e77303 (62c487c8-9845-4184-9761-a727e6e77303): created successfully
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580212d3-b9fc-42cc-810c-d007f699d4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Flow 'volume_create_manager' (4047e782-640a-4ca9-8f6b-d4c96cef52f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e 1073741824" returned: 0 in 0.741s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:51 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Flow 'volume_create_manager' (c1d45d1d-a812-4baf-8d00-f8f465cf2b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8993ecb6-6544-479d-a8ff-f91da7e881a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513e0ceb-421c-46e2-9e3c-7df3168ac508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-791588771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d59eed-2b0c-41c7-8de6-50dd09b18a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f81450e62914f05904f213b9687adea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:51Z,use_quota=True,user_id='a727bf52e4ad491bb130afec0910a2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6eb6bb-50e3-4d2b-941f-42c900b22e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6eb6bb-50e3-4d2b-941f-42c900b22e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b336dd9-1fef-44bf-96be-69338d7c9e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b336dd9-1fef-44bf-96be-69338d7c9e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99d59eed-2b0c-41c7-8de6-50dd09b18a22', 'volume_name': 'volume-99d59eed-2b0c-41c7-8de6-50dd09b18a22', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0a676d-67da-49bc-ac5b-cd284654459e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0a676d-67da-49bc-ac5b-cd284654459e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4637aa34-7e99-44d2-8c2d-a1b1a3fa61dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:52 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume 99d59eed-2b0c-41c7-8de6-50dd09b18a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99d59eed-2b0c-41c7-8de6-50dd09b18a22', 'volume_size': 1}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8993ecb6-6544-479d-a8ff-f91da7e881a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-166654087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923a6e5f-b410-47e5-a71e-7e4a8d1319fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f81450e62914f05904f213b9687adea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:51Z,use_quota=True,user_id='a727bf52e4ad491bb130afec0910a2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb576c0-b42d-498b-a57d-9161aa5fa314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb576c0-b42d-498b-a57d-9161aa5fa314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78324032-8e2b-4d6d-bc96-8efb152f979c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78324032-8e2b-4d6d-bc96-8efb152f979c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '923a6e5f-b410-47e5-a71e-7e4a8d1319fc', 'volume_name': 'volume-923a6e5f-b410-47e5-a71e-7e4a8d1319fc', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b38f9e-c2a7-4a3c-b11a-252bc8781bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b38f9e-c2a7-4a3c-b11a-252bc8781bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2977de0-e33b-4da4-ab6a-476442310609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:52 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume 923a6e5f-b410-47e5-a71e-7e4a8d1319fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-923a6e5f-b410-47e5-a71e-7e4a8d1319fc', 'volume_size': 1}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:52 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Flow 'volume_create_manager' (f91d85fe-0563-402a-a332-5c40f2a2ac10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2983bfb-82a3-4249-b798-20558826287c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:52 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-1a2c70d2-a941-4ed4-ba3b-bc71d3cf671b tempest-CinderUnicodeTest-639774115 None] Created volume successfully.
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e" returned: 0 in 0.629s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] <== create_volume: return (1429ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.732s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-744567693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956f4052-3285-41a6-8a35-e545e6625aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e768f8640641ed9d74369090ace30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:47Z,use_quota=True,user_id='23f080493c604f42a4c6d7234d198fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Creating volume 956f4052-3285-41a6-8a35-e545e6625aff {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:29:52 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-956f4052-3285-41a6-8a35-e545e6625aff 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:52 devstack quobyte-client[84147]: System call of process 101256 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:29:52 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=150, name=volume-956f4052-3285-41a6-8a35-e545e6625aff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2983bfb-82a3-4249-b798-20558826287c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-626812409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382eb0c9-f976-4994-beee-aa6781621fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f81450e62914f05904f213b9687adea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:52Z,use_quota=True,user_id='a727bf52e4ad491bb130afec0910a2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be93b2fc-930b-4aef-bede-96f24e1f042c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be93b2fc-930b-4aef-bede-96f24e1f042c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a7a86c-ffb9-47a3-9093-9f11b54593fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a7a86c-ffb9-47a3-9093-9f11b54593fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '382eb0c9-f976-4994-beee-aa6781621fa7', 'volume_name': 'volume-382eb0c9-f976-4994-beee-aa6781621fa7', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350b80c4-3dd0-4359-846a-5e891767f12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350b80c4-3dd0-4359-846a-5e891767f12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:52 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274a4a51-cefa-4cec-a217-944271aaf1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:53 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume 382eb0c9-f976-4994-beee-aa6781621fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-382eb0c9-f976-4994-beee-aa6781621fa7', 'volume_size': 1}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e363f79a-7c35-4f29-8561-3e93ee3fb5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9496f2-d677-403a-93da-aa6d73f37555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-956f4052-3285-41a6-8a35-e545e6625aff 1073741824" returned: 0 in 0.569s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-956f4052-3285-41a6-8a35-e545e6625aff {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-956f4052-3285-41a6-8a35-e545e6625aff" returned: 0 in 0.302s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] <== create_volume: return (963ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1679746178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3fd84c1-5aac-4d1f-a225-76c790b3d4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e768f8640641ed9d74369090ace30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:48Z,use_quota=True,user_id='23f080493c604f42a4c6d7234d198fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Creating volume c3fd84c1-5aac-4d1f-a225-76c790b3d4dc {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:29:53 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:53 devstack quobyte-client[84147]: System call of process 101261 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:29:53 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=151, name=volume-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:29:53 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:53 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Flow 'volume_create_manager' (814d7b09-6744-4df0-8684-3d7e0f846a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88aef62d-a5c7-425d-99d7-1ef9ea383d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:54 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Volume volume-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e (6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e): created successfully
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9496f2-d677-403a-93da-aa6d73f37555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Flow 'volume_create_manager' (e54e04c1-b5a0-42d0-a74c-ec78736a93e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:54 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5f22011f-3fa6-4d1c-816a-e15fad3e42fe tempest-CreateVolumesFromImageTest-1443773779 None] Created volume successfully.
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88aef62d-a5c7-425d-99d7-1ef9ea383d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1622379823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d32838-78c1-40dc-ae8d-98771537b017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63f4955a3a8549b6ac0863fe36632f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:53Z,use_quota=True,user_id='070b6679f97047b9a3145ebd73bc6fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e96525-fe2a-4549-a376-5a929a629dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e96525-fe2a-4549-a376-5a929a629dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3475746e-213e-492d-9685-79f43a278d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3475746e-213e-492d-9685-79f43a278d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d32838-78c1-40dc-ae8d-98771537b017', 'volume_name': 'volume-a1d32838-78c1-40dc-ae8d-98771537b017', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9799644-4f71-4d53-95e9-cf924a2f1710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9799644-4f71-4d53-95e9-cf924a2f1710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87bb16f0-2260-4b08-a9ee-f429f90b242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:54 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Volume a1d32838-78c1-40dc-ae8d-98771537b017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d32838-78c1-40dc-ae8d-98771537b017', 'volume_size': 1}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc 1073741824" returned: 0 in 0.636s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e997ef-7ab3-4979-9ebe-c5ec411d8b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-956f4052-3285-41a6-8a35-e545e6625aff', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7874aef5-d762-4ff7-9dc1-a8599f6b5aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc" returned: 0 in 0.339s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] <== create_volume: return (1002ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.294s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1603564059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8324690f-ba7d-435e-8243-77592730b174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e768f8640641ed9d74369090ace30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:49Z,use_quota=True,user_id='23f080493c604f42a4c6d7234d198fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Creating volume 8324690f-ba7d-435e-8243-77592730b174 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:29:54 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8324690f-ba7d-435e-8243-77592730b174 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:54 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=152, name=volume-8324690f-ba7d-435e-8243-77592730b174, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:29:54 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Volume volume-956f4052-3285-41a6-8a35-e545e6625aff (956f4052-3285-41a6-8a35-e545e6625aff): created successfully
Sep 18 01:29:54 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7874aef5-d762-4ff7-9dc1-a8599f6b5aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Flow 'volume_create_manager' (1a9211dc-1e63-4a28-9e57-15a2cba2d5dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0679cc6b-a31b-4c7d-8b7a-9fb7f93010f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8113c963-54f3-4daa-ac62-85aef7ecf66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8324690f-ba7d-435e-8243-77592730b174 1073741824" returned: 0 in 0.492s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8324690f-ba7d-435e-8243-77592730b174 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:55 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-384473cd-8f67-48e5-9acb-ee2c1015766d tempest-CreateVolumesFromImageTest-1443773779 None] Created volume successfully.
Sep 18 01:29:55 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Volume volume-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc (c3fd84c1-5aac-4d1f-a225-76c790b3d4dc): created successfully
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8113c963-54f3-4daa-ac62-85aef7ecf66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Flow 'volume_create_manager' (020b600f-7ff8-48e9-89b2-f288da9067b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8324690f-ba7d-435e-8243-77592730b174" returned: 0 in 0.410s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] <== create_volume: return (930ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.634s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-7120306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8124278c-5dd2-407c-8c19-98d1414e208f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f81450e62914f05904f213b9687adea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:50Z,use_quota=True,user_id='a727bf52e4ad491bb130afec0910a2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Creating volume 8124278c-5dd2-407c-8c19-98d1414e208f {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:29:55 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:29:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8124278c-5dd2-407c-8c19-98d1414e208f 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:55 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-78bd1256-b3af-4930-8e82-b46731a2a345 tempest-CreateVolumesFromImageTest-1443773779 None] Created volume successfully.
Sep 18 01:29:55 devstack quobyte-client[84147]: System call of process 101269 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:29:55 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=153, name=volume-8124278c-5dd2-407c-8c19-98d1414e208f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae61eee-08de-4282-887d-93712cf5c690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8324690f-ba7d-435e-8243-77592730b174', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea82998e-b95b-4e63-a371-6a93588cb907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8124278c-5dd2-407c-8c19-98d1414e208f 1073741824" returned: 0 in 0.504s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8124278c-5dd2-407c-8c19-98d1414e208f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:56 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Volume volume-8324690f-ba7d-435e-8243-77592730b174 (8324690f-ba7d-435e-8243-77592730b174): created successfully
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea82998e-b95b-4e63-a371-6a93588cb907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Flow 'volume_create_manager' (6da3af38-9b53-482e-8ed4-6cf1734f2430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8124278c-5dd2-407c-8c19-98d1414e208f" returned: 0 in 0.355s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] <== create_volume: return (887ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.022s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-666039585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5093ac6-37b5-4ac9-9e2a-160090db3367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f81450e62914f05904f213b9687adea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:50Z,use_quota=True,user_id='a727bf52e4ad491bb130afec0910a2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Creating volume b5093ac6-37b5-4ac9-9e2a-160090db3367 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:29:56 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:29:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b5093ac6-37b5-4ac9-9e2a-160090db3367 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:56 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=154, name=volume-b5093ac6-37b5-4ac9-9e2a-160090db3367, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:29:56 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-93a2c765-3601-4559-8795-427ecc1ab696 tempest-CreateVolumesFromImageTest-1443773779 None] Created volume successfully.
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d223591d-a9a8-4469-9723-60956b0d37d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8124278c-5dd2-407c-8c19-98d1414e208f', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071ca216-0872-4597-ae3c-3dcc306fbd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b5093ac6-37b5-4ac9-9e2a-160090db3367 1073741824" returned: 0 in 0.491s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b5093ac6-37b5-4ac9-9e2a-160090db3367 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:57 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume volume-8124278c-5dd2-407c-8c19-98d1414e208f (8124278c-5dd2-407c-8c19-98d1414e208f): created successfully
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071ca216-0872-4597-ae3c-3dcc306fbd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Flow 'volume_create_manager' (ba9359d7-42ba-4ea7-85d2-7c3d00322518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "cinder-8324690f-ba7d-435e-8243-77592730b174-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:29:57 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b39e5ada-779a-40dd-8aee-99fab058c874 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Created volume successfully.
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b5093ac6-37b5-4ac9-9e2a-160090db3367" returned: 0 in 0.462s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] <== create_volume: return (998ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.351s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-791588771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d59eed-2b0c-41c7-8de6-50dd09b18a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f81450e62914f05904f213b9687adea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:51Z,use_quota=True,user_id='a727bf52e4ad491bb130afec0910a2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Creating volume 99d59eed-2b0c-41c7-8de6-50dd09b18a22 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:29:57 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-99d59eed-2b0c-41c7-8de6-50dd09b18a22 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:57 devstack quobyte-client[84147]: System call of process 101277 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:29:57 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=155, name=volume-99d59eed-2b0c-41c7-8de6-50dd09b18a22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:29:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-8324690f-ba7d-435e-8243-77592730b174-delete_volume" acquired by "delete_volume" :: waited 0.321s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5745b43e-1985-40b8-9728-b7e72fa93005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5093ac6-37b5-4ac9-9e2a-160090db3367', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef751e3-964c-4caa-ae58-875ff7bf250e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.410s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-99d59eed-2b0c-41c7-8de6-50dd09b18a22 1073741824" returned: 0 in 0.831s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-99d59eed-2b0c-41c7-8de6-50dd09b18a22 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:58 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume volume-b5093ac6-37b5-4ac9-9e2a-160090db3367 (b5093ac6-37b5-4ac9-9e2a-160090db3367): created successfully
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef751e3-964c-4caa-ae58-875ff7bf250e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Flow 'volume_create_manager' (49b2015e-0352-4aab-8663-3ebcd35a9138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-99d59eed-2b0c-41c7-8de6-50dd09b18a22" returned: 0 in 0.477s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] <== create_volume: return (1391ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:29:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:59 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "cinder-quobyte-8324690f-ba7d-435e-8243-77592730b174" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.724s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-166654087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923a6e5f-b410-47e5-a71e-7e4a8d1319fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f81450e62914f05904f213b9687adea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:51Z,use_quota=True,user_id='a727bf52e4ad491bb130afec0910a2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Creating volume 923a6e5f-b410-47e5-a71e-7e4a8d1319fc {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:29:59 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-923a6e5f-b410-47e5-a71e-7e4a8d1319fc 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:59 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=156, name=volume-923a6e5f-b410-47e5-a71e-7e4a8d1319fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:29:59 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-cce43ff7-efb3-4859-9d96-8b705884be7f tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Created volume successfully.
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4637aa34-7e99-44d2-8c2d-a1b1a3fa61dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99d59eed-2b0c-41c7-8de6-50dd09b18a22', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00930c15-5bea-4970-a2d6-f533014f980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-quobyte-8324690f-ba7d-435e-8243-77592730b174" acquired by "delete_volume" :: waited 0.558s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b57a687-1f25-4197-83ef-40ba53d5d7e6]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8324690f-ba7d-435e-8243-77592730b174 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-923a6e5f-b410-47e5-a71e-7e4a8d1319fc 1073741824" returned: 0 in 0.631s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-923a6e5f-b410-47e5-a71e-7e4a8d1319fc {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:29:59 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume volume-99d59eed-2b0c-41c7-8de6-50dd09b18a22 (99d59eed-2b0c-41c7-8de6-50dd09b18a22): created successfully
Sep 18 01:29:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00930c15-5bea-4970-a2d6-f533014f980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Flow 'volume_create_manager' (1dacb466-db5a-4e13-a78c-21b4d1173b7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-923a6e5f-b410-47e5-a71e-7e4a8d1319fc" returned: 0 in 0.431s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] <== create_volume: return (1152ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.237s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-626812409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382eb0c9-f976-4994-beee-aa6781621fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f81450e62914f05904f213b9687adea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:52Z,use_quota=True,user_id='a727bf52e4ad491bb130afec0910a2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Creating volume 382eb0c9-f976-4994-beee-aa6781621fa7 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:30:00 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-382eb0c9-f976-4994-beee-aa6781621fa7 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:00 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3c15d78e-96bf-41ba-baa2-40c5f7a4ed97 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Created volume successfully.
Sep 18 01:30:00 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=157, name=volume-382eb0c9-f976-4994-beee-aa6781621fa7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2977de0-e33b-4da4-ab6a-476442310609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-923a6e5f-b410-47e5-a71e-7e4a8d1319fc', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5063276-ced7-4a8f-8136-7d9c66b6297e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8324690f-ba7d-435e-8243-77592730b174" returned: 0 in 1.081s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8324690f-ba7d-435e-8243-77592730b174 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:00 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume volume-923a6e5f-b410-47e5-a71e-7e4a8d1319fc (923a6e5f-b410-47e5-a71e-7e4a8d1319fc): created successfully
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5063276-ced7-4a8f-8136-7d9c66b6297e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Flow 'volume_create_manager' (c1d45d1d-a812-4baf-8d00-f8f465cf2b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-382eb0c9-f976-4994-beee-aa6781621fa7 1073741824" returned: 0 in 0.802s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-382eb0c9-f976-4994-beee-aa6781621fa7 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:01 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-49fa7fa8-01b1-478b-ad4b-6e0e8a631812 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Created volume successfully.
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8324690f-ba7d-435e-8243-77592730b174" returned: 0 in 0.610s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-quobyte-8324690f-ba7d-435e-8243-77592730b174" released by "delete_volume" :: held 1.839s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-382eb0c9-f976-4994-beee-aa6781621fa7" returned: 0 in 0.375s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] <== create_volume: return (1235ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.213s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:29:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1622379823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d32838-78c1-40dc-ae8d-98771537b017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63f4955a3a8549b6ac0863fe36632f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:29:53Z,use_quota=True,user_id='070b6679f97047b9a3145ebd73bc6fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Creating volume a1d32838-78c1-40dc-ae8d-98771537b017 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:30:01 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:01 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=158, name=volume-a1d32838-78c1-40dc-ae8d-98771537b017, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:30:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274a4a51-cefa-4cec-a217-944271aaf1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-382eb0c9-f976-4994-beee-aa6781621fa7', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eee07a9-8e8d-4185-8396-4a4ab48b79b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017 1073741824" returned: 0 in 0.521s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:02 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume volume-382eb0c9-f976-4994-beee-aa6781621fa7 (382eb0c9-f976-4994-beee-aa6781621fa7): created successfully
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eee07a9-8e8d-4185-8396-4a4ab48b79b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Flow 'volume_create_manager' (f91d85fe-0563-402a-a332-5c40f2a2ac10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:02 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-c827a560-6334-4ed1-b262-d727deda44c1 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Created volume successfully.
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017" returned: 0 in 0.370s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] <== create_volume: return (919ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87bb16f0-2260-4b08-a9ee-f429f90b242b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d32838-78c1-40dc-ae8d-98771537b017', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51f859c-c691-4478-96f9-aed901d70980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:02 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Volume volume-a1d32838-78c1-40dc-ae8d-98771537b017 (a1d32838-78c1-40dc-ae8d-98771537b017): created successfully
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51f859c-c691-4478-96f9-aed901d70980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Flow 'volume_create_manager' (814d7b09-6744-4df0-8684-3d7e0f846a30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Created reservations ['7eceb6d4-7efb-4f08-b82e-4a3ed3dc7343', 'c9414655-0e83-45dd-be92-6f6339ef79c5', '3f160dcc-4083-4cd2-9c39-0cecd5293c1c', '08063c32-47db-4310-8aaa-7546157f6d2a'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:02 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-bcafbdf6-3665-472b-b479-a3b0497132c5 tempest-CinderUnicodeTest-639774115 None] Created volume successfully.
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.106s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:02 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:03 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Deleted volume successfully.
Sep 18 01:30:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "cinder-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "cinder-382eb0c9-f976-4994-beee-aa6781621fa7-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-02f8941f-8ff1-4691-a734-c8247bb98a8c tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-8324690f-ba7d-435e-8243-77592730b174-delete_volume" released by "delete_volume" :: held 5.600s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-382eb0c9-f976-4994-beee-aa6781621fa7-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:03 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "cinder-quobyte-382eb0c9-f976-4994-beee-aa6781621fa7" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:03 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "cinder-quobyte-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-quobyte-382eb0c9-f976-4994-beee-aa6781621fa7" acquired by "delete_volume" :: waited 0.017s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:03 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df2d138-963c-4c6d-a981-91ebc61fb5b3]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:03 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-quobyte-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc" acquired by "delete_volume" :: waited 0.042s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-382eb0c9-f976-4994-beee-aa6781621fa7 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:03 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07a3410-72fd-47b7-a344-d4c71cf1d3eb]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-382eb0c9-f976-4994-beee-aa6781621fa7" returned: 0 in 0.675s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-382eb0c9-f976-4994-beee-aa6781621fa7 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:04 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] Creating offline snapshot d0810213-5927-47f7-85ba-01b63996e93b of volume a1d32838-78c1-40dc-ae8d-98771537b017 {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:30:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc" returned: 0 in 0.999s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-382eb0c9-f976-4994-beee-aa6781621fa7" returned: 0 in 0.520s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:05 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3d1858-e63c-4ce3-beeb-06b1b033b0f2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-quobyte-382eb0c9-f976-4994-beee-aa6781621fa7" released by "delete_volume" :: held 1.615s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc" returned: 0 in 0.490s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-quobyte-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc" released by "delete_volume" :: held 1.905s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017" returned: 0 in 0.608s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:05 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Created reservations ['d03a64c7-377d-484a-800b-d3ffca978507', '05a33c57-7424-4322-8ecd-95749c257fae', '1bc13d76-b707-474a-bd27-0daad1a6b8ae', 'd8839f10-b842-4800-ac85-a326176d92e2'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:05 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=159, name=volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:30:06 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Created reservations ['0e5763ed-bea7-423e-914b-caa536daa51d', '5f151be4-8bc2-4c49-8e07-cdb350c47cd6', 'bdf0eb88-d1d0-4a1b-a052-ef4e622806d0', 'e6393768-dc6d-4e05-b3d6-d700dc9a939c'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b 1G" returned: 0 in 0.413s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a1d32838-78c1-40dc-ae8d-98771537b017 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] CMD "qemu-img rebase -u -b volume-a1d32838-78c1-40dc-ae8d-98771537b017 -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b" returned: 0 in 0.263s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:06 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:30:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "cinder-923a6e5f-b410-47e5-a71e-7e4a8d1319fc-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b" returned: 0 in 0.564s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:06 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:06 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017 -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:30:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:07 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-923a6e5f-b410-47e5-a71e-7e4a8d1319fc-delete_volume" acquired by "delete_volume" :: waited 0.679s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "cinder-0b9a2db9-9186-4df7-b073-096501b2d6d8-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b" returned: 0 in 0.663s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.858s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:07 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:08 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Deleted volume successfully.
Sep 18 01:30:08 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "cinder-quobyte-923a6e5f-b410-47e5-a71e-7e4a8d1319fc" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.977s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:08 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-0b9a2db9-9186-4df7-b073-096501b2d6d8-delete_volume" acquired by "delete_volume" :: waited 0.591s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.info" returned: 0 in 0.569s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:08 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:30:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:08 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Deleted volume successfully.
Sep 18 01:30:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-011db6e6-110a-4abe-a02b-5295c57ebc18 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-382eb0c9-f976-4994-beee-aa6781621fa7-delete_volume" released by "delete_volume" :: held 5.225s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-quobyte-923a6e5f-b410-47e5-a71e-7e4a8d1319fc" acquired by "delete_volume" :: waited 0.571s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:08 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "cinder-quobyte-0b9a2db9-9186-4df7-b073-096501b2d6d8" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:08 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[144d45dd-fb8e-4bc7-8398-19d6f9b33cb1]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-923a6e5f-b410-47e5-a71e-7e4a8d1319fc {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.info" returned: 0 in 0.739s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-ef3f7852-26eb-4448-a328-38b7df7c0789 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-c3fd84c1-5aac-4d1f-a225-76c790b3d4dc-delete_volume" released by "delete_volume" :: held 5.712s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.605s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-quobyte-0b9a2db9-9186-4df7-b073-096501b2d6d8" acquired by "delete_volume" :: waited 0.416s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:09 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a370be36-cfc1-45cd-829f-ba42afa86f76]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b9a2db9-9186-4df7-b073-096501b2d6d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:09 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-eae5527f-52ca-4068-98e6-bee0ac6ca448 tempest-CinderUnicodeTest-639774115 None] Create snapshot completed successfully
Sep 18 01:30:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-923a6e5f-b410-47e5-a71e-7e4a8d1319fc" returned: 0 in 0.857s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-923a6e5f-b410-47e5-a71e-7e4a8d1319fc {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-923a6e5f-b410-47e5-a71e-7e4a8d1319fc" returned: 0 in 0.303s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Acquiring lock "cinder-d0810213-5927-47f7-85ba-01b63996e93b-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b9a2db9-9186-4df7-b073-096501b2d6d8" returned: 0 in 0.877s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b9a2db9-9186-4df7-b073-096501b2d6d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-quobyte-923a6e5f-b410-47e5-a71e-7e4a8d1319fc" released by "delete_volume" :: held 1.667s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Lock "cinder-d0810213-5927-47f7-85ba-01b63996e93b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.506s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:10 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Acquiring lock "cinder-quobyte-a1d32838-78c1-40dc-ae8d-98771537b017" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-0b9a2db9-9186-4df7-b073-096501b2d6d8" returned: 0 in 0.540s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Lock "cinder-quobyte-a1d32838-78c1-40dc-ae8d-98771537b017" acquired by "delete_snapshot" :: waited 0.093s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:10 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Acquiring lock "cinder-quobyte-d0810213-5927-47f7-85ba-01b63996e93b" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-quobyte-0b9a2db9-9186-4df7-b073-096501b2d6d8" released by "delete_volume" :: held 1.713s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:11 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Created reservations ['a8a5d17c-e8f8-44e3-9ec4-f99e428972ee', '25398769-bd43-4c38-915f-2bfbf06a2edb', 'bbfeddce-61c8-40f5-ad9f-5c36381c4b10', 'c83dde58-adce-4681-9c2d-4c0ff6141987'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Lock "cinder-quobyte-d0810213-5927-47f7-85ba-01b63996e93b" acquired by "_delete_snapshot" :: waited 0.201s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Deleting offline snapshot d0810213-5927-47f7-85ba-01b63996e93b of volume a1d32838-78c1-40dc-ae8d-98771537b017 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:30:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] snapshot_file for this snap is: volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:30:11 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04f245f-e5a2-40fb-bdfa-03aa865eaa1e]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:11 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Created reservations ['47818889-9cbb-4ca7-a9f4-6d91aae7f34e', 'da40cbae-df7e-4a31-b7cc-640682ee7640', '8709e5ee-21f6-46ab-8298-80e7e33791aa', 'c4966ac5-1ab1-4ce1-944c-f1558ca72a66'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b" returned: 0 in 0.838s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:12 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d32838-78c1-40dc-ae8d-98771537b017(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:30:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.423s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:12 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:12 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bdaeae-3e50-405e-9938-3de228a1cf98]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "cinder-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "cinder-99d59eed-2b0c-41c7-8de6-50dd09b18a22-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:12 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Deleted volume successfully.
Sep 18 01:30:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e-delete_volume" acquired by "delete_volume" :: waited 0.206s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-99d59eed-2b0c-41c7-8de6-50dd09b18a22-delete_volume" acquired by "delete_volume" :: waited 0.196s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-97b7b56c-eafe-41d9-bc14-c6402711b6ae tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-923a6e5f-b410-47e5-a71e-7e4a8d1319fc-delete_volume" released by "delete_volume" :: held 5.473s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:12 devstack quobyte-client[84147]: System call of process 101338 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:30:13 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "cinder-quobyte-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017" returned: 0 in 1.381s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:13 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "cinder-quobyte-99d59eed-2b0c-41c7-8de6-50dd09b18a22" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:13 devstack quobyte-client[84147]: System call of process 101343 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-quobyte-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e" acquired by "delete_volume" :: waited 0.708s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.831s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd6d56f-8b94-4662-b478-a5d6245f441d]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:13 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:14 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Deleted volume successfully.
Sep 18 01:30:14 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-quobyte-99d59eed-2b0c-41c7-8de6-50dd09b18a22" acquired by "delete_volume" :: waited 0.668s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:14 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2111f228-8577-4f5a-8565-344c7cbdf191]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-99d59eed-2b0c-41c7-8de6-50dd09b18a22 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b" returned: 0 in 0.862s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:14 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-2ac8abb8-4623-4187-8202-83deee32bded tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-0b9a2db9-9186-4df7-b073-096501b2d6d8-delete_volume" released by "delete_volume" :: held 6.264s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e" returned: 0 in 0.832s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017.d0810213-5927-47f7-85ba-01b63996e93b" returned: 0 in 0.174s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:14 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e" returned: 0 in 0.202s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Lock "cinder-quobyte-d0810213-5927-47f7-85ba-01b63996e93b" released by "_delete_snapshot" :: held 3.966s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-99d59eed-2b0c-41c7-8de6-50dd09b18a22" returned: 0 in 0.758s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-99d59eed-2b0c-41c7-8de6-50dd09b18a22 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Lock "cinder-quobyte-a1d32838-78c1-40dc-ae8d-98771537b017" released by "delete_snapshot" :: held 4.294s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-quobyte-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e" released by "delete_volume" :: held 1.617s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-99d59eed-2b0c-41c7-8de6-50dd09b18a22" returned: 0 in 0.394s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-quobyte-99d59eed-2b0c-41c7-8de6-50dd09b18a22" released by "delete_volume" :: held 1.300s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Created reservations ['6f4dce53-3dbe-4670-a56e-dc1b6ba012bf', 'b5ab64f3-0f95-49ef-8b58-1b56fdbbd271', '2b2a097d-c718-47de-9b60-00f84072433f', 'b272eaad-8026-4044-b8d1-bcda7a9e1a9e'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Created reservations ['18c4df9c-731f-4937-8917-bfb9976051dc', '93d3d597-ec27-4d78-8831-9eb7efe22128', '1e2e66d1-0c35-4212-88bb-0c1940e52369', '66b00d6d-0edb-48dc-9dd5-4f70009a8219'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Created reservations ['b01943f8-c25f-482f-9d82-516aac39ec4c', '716e46af-8f47-43d0-979b-93fc35117b02', '2efca599-a3ce-4b59-98f5-e1a6828f1086', '708d17aa-9b79-4d0f-90fb-421e1e83539e'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:15 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Delete snapshot completed successfully.
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:15 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-617fe49e-463d-4a12-a1a7-866e33ba81e2 tempest-CinderUnicodeTest-639774115 None] Lock "cinder-d0810213-5927-47f7-85ba-01b63996e93b-delete_snapshot" released by "delete_snapshot" :: held 5.322s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.278s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:16 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Deleted volume successfully.
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.181s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-038fd1f7-d6f9-4938-a9b0-668dc2a442f6 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-6f17add7-d4bd-4b0f-a2ef-c3a8fc9b5a2e-delete_volume" released by "delete_volume" :: held 3.768s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:16 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Deleted volume successfully.
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8f4cf82d-2403-49d0-956e-af0eadd8fa17 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-99d59eed-2b0c-41c7-8de6-50dd09b18a22-delete_volume" released by "delete_volume" :: held 3.867s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Acquiring lock "cinder-a1d32838-78c1-40dc-ae8d-98771537b017-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "cinder-956f4052-3285-41a6-8a35-e545e6625aff-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-956f4052-3285-41a6-8a35-e545e6625aff-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Lock "cinder-a1d32838-78c1-40dc-ae8d-98771537b017-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:16 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "cinder-b5093ac6-37b5-4ac9-9e2a-160090db3367-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-b5093ac6-37b5-4ac9-9e2a-160090db3367-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:17 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Acquiring lock "cinder-quobyte-a1d32838-78c1-40dc-ae8d-98771537b017" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:17 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "cinder-quobyte-956f4052-3285-41a6-8a35-e545e6625aff" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Lock "cinder-quobyte-a1d32838-78c1-40dc-ae8d-98771537b017" acquired by "delete_volume" :: waited 0.022s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-quobyte-956f4052-3285-41a6-8a35-e545e6625aff" acquired by "delete_volume" :: waited 0.052s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d43f20-8a65-42e0-90e6-db3e9a03c37c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c929aa79-0549-4583-8160-370dc4f12d28]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-956f4052-3285-41a6-8a35-e545e6625aff {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:17 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "cinder-quobyte-b5093ac6-37b5-4ac9-9e2a-160090db3367" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-quobyte-b5093ac6-37b5-4ac9-9e2a-160090db3367" acquired by "delete_volume" :: waited 0.082s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[523dcabf-9643-46da-b124-297963a4b2c7]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b5093ac6-37b5-4ac9-9e2a-160090db3367 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017" returned: 0 in 0.660s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-956f4052-3285-41a6-8a35-e545e6625aff" returned: 0 in 0.873s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-956f4052-3285-41a6-8a35-e545e6625aff {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-a1d32838-78c1-40dc-ae8d-98771537b017" returned: 0 in 0.311s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:18 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Lock "cinder-quobyte-a1d32838-78c1-40dc-ae8d-98771537b017" released by "delete_volume" :: held 1.229s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-956f4052-3285-41a6-8a35-e545e6625aff" returned: 0 in 0.376s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b5093ac6-37b5-4ac9-9e2a-160090db3367" returned: 0 in 0.831s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b5093ac6-37b5-4ac9-9e2a-160090db3367 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:18 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-quobyte-956f4052-3285-41a6-8a35-e545e6625aff" released by "delete_volume" :: held 1.592s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-b5093ac6-37b5-4ac9-9e2a-160090db3367" returned: 0 in 0.405s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-quobyte-b5093ac6-37b5-4ac9-9e2a-160090db3367" released by "delete_volume" :: held 1.306s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Created reservations ['e735fe7d-f7cf-4374-a2b5-00b0a9f565fb', '8ab53f78-b4bf-4c1d-97a4-6a984cbb6e75', '01fe42dc-b281-4062-ae5a-2905cbe624fd', 'f328fd17-8871-4f56-8b02-2249223acf73'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Created reservations ['a16c94da-e5fc-4f87-b295-1f2458e2a249', 'd0fa8bb4-184d-44b7-8a04-bd4ca4cb1171', 'fa3df778-7782-4244-8be0-bdac5f1d2e61', '4607fead-1b10-47ce-81fa-97f22a71484c'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Created reservations ['14786e8a-ab70-4fca-a1d3-361bda4c1610', '500a6d4c-bc81-464e-af6c-0dc666fc1423', '5c1e67c1-1590-4934-8699-628cb8a136a0', 'e66f0b8f-0264-4088-8e9f-ceb04b4f791f'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.561s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.345s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:19 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Deleted volume successfully.
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:19 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:20 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Deleted volume successfully.
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Acquiring lock "cinder-62c487c8-9845-4184-9761-a727e6e77303-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "cinder-8124278c-5dd2-407c-8c19-98d1414e208f-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-926b08c5-10ab-4c1a-b2ec-a9861bf1308b tempest-CinderUnicodeTest-639774115 None] Lock "cinder-a1d32838-78c1-40dc-ae8d-98771537b017-delete_volume" released by "delete_volume" :: held 3.583s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.569s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5ad35373-071a-4aca-897b-fadb403bdc53 tempest-CreateVolumesFromImageTest-1443773779 None] Lock "cinder-956f4052-3285-41a6-8a35-e545e6625aff-delete_volume" released by "delete_volume" :: held 3.644s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:20 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Deleted volume successfully.
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-8124278c-5dd2-407c-8c19-98d1414e208f-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Lock "cinder-62c487c8-9845-4184-9761-a727e6e77303-delete_volume" acquired by "delete_volume" :: waited 0.147s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-6c24b451-c812-4543-a3ea-da4376feef46 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-b5093ac6-37b5-4ac9-9e2a-160090db3367-delete_volume" released by "delete_volume" :: held 3.583s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:20 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Acquiring lock "cinder-quobyte-62c487c8-9845-4184-9761-a727e6e77303" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:20 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "cinder-quobyte-8124278c-5dd2-407c-8c19-98d1414e208f" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Lock "cinder-quobyte-62c487c8-9845-4184-9761-a727e6e77303" acquired by "delete_volume" :: waited 0.046s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3149c0bf-16bf-438c-9298-31d48a0c410e]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c487c8-9845-4184-9761-a727e6e77303 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-quobyte-8124278c-5dd2-407c-8c19-98d1414e208f" acquired by "delete_volume" :: waited 0.185s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:21 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4eb58a-b435-4c36-84fa-bd2dd35d2fe0]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8124278c-5dd2-407c-8c19-98d1414e208f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c487c8-9845-4184-9761-a727e6e77303" returned: 0 in 0.625s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c487c8-9845-4184-9761-a727e6e77303 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-62c487c8-9845-4184-9761-a727e6e77303" returned: 0 in 0.148s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:21 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Lock "cinder-quobyte-62c487c8-9845-4184-9761-a727e6e77303" released by "delete_volume" :: held 1.000s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8124278c-5dd2-407c-8c19-98d1414e208f" returned: 0 in 0.938s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8124278c-5dd2-407c-8c19-98d1414e208f {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-8124278c-5dd2-407c-8c19-98d1414e208f" returned: 0 in 0.266s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:22 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-quobyte-8124278c-5dd2-407c-8c19-98d1414e208f" released by "delete_volume" :: held 1.440s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:22 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Created reservations ['ce3826e9-2d3b-44fd-95e8-bde49fba72c6', 'ada44f93-8f47-46fd-9aba-049e247c52e0', 'ecbc976e-7bc5-4244-8174-8a5433ea4fa6', '6b69a43d-35ee-4d26-a234-39c2cc0a5236'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:22 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Created reservations ['ec9e3759-c739-4d4c-928d-447e8d7dd813', 'd7644aee-d006-49ca-997b-39c275736ecc', 'eb22c781-1873-4152-8772-362aff052a88', 'd7a024cc-5a6b-497d-94e4-a705e36344bf'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:22 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:22 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.328s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:23 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:23 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Deleted volume successfully.
Sep 18 01:30:23 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-dcc576e0-8fa2-43d7-a204-a05116fbb065 tempest-CinderUnicodeTest-639774115 None] Lock "cinder-62c487c8-9845-4184-9761-a727e6e77303-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.102s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:23 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:23 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Deleted volume successfully.
Sep 18 01:30:23 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-7e5d8c16-2a58-4848-8976-00e9bb93a16c tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-8124278c-5dd2-407c-8c19-98d1414e208f-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:23 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "cinder-496cf8ca-d6e5-41ad-a902-2583d4faa7ec-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-496cf8ca-d6e5-41ad-a902-2583d4faa7ec-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:24 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "cinder-quobyte-496cf8ca-d6e5-41ad-a902-2583d4faa7ec" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-quobyte-496cf8ca-d6e5-41ad-a902-2583d4faa7ec" acquired by "delete_volume" :: waited 0.016s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:24 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[114ffab1-d31a-4e51-bb6a-e55bbef4bca9]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-496cf8ca-d6e5-41ad-a902-2583d4faa7ec {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:24 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:24 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:30:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Flow 'volume_create_manager' (a5af11cd-ba03-46f3-af25-0e44adb5cc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:24 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876b6aa3-1c36-4ce7-99b1-7f6e2c181e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-496cf8ca-d6e5-41ad-a902-2583d4faa7ec" returned: 0 in 0.753s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-496cf8ca-d6e5-41ad-a902-2583d4faa7ec {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876b6aa3-1c36-4ce7-99b1-7f6e2c181e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-213025088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7591cfd-519d-456a-ac55-e8d9d5178eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327d600395a7477fadce95c2f95a78e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:24Z,use_quota=True,user_id='50aedd1f8bb74607b07586824661d724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3c1a36-d11b-4e9c-97a3-2e30c71cf1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3c1a36-d11b-4e9c-97a3-2e30c71cf1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c284bbf7-d4b0-43d0-850a-c27351ec069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c284bbf7-d4b0-43d0-850a-c27351ec069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7591cfd-519d-456a-ac55-e8d9d5178eda', 'volume_name': 'volume-c7591cfd-519d-456a-ac55-e8d9d5178eda', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d3ff85-d15d-4009-a1d3-d1328da8cf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d3ff85-d15d-4009-a1d3-d1328da8cf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc84de29-36a8-495c-b036-f85962f64572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:25 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume c7591cfd-519d-456a-ac55-e8d9d5178eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7591cfd-519d-456a-ac55-e8d9d5178eda', 'volume_size': 1}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-213025088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7591cfd-519d-456a-ac55-e8d9d5178eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327d600395a7477fadce95c2f95a78e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:24Z,use_quota=True,user_id='50aedd1f8bb74607b07586824661d724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Creating volume c7591cfd-519d-456a-ac55-e8d9d5178eda {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:30:25 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:25 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=161, name=volume-c7591cfd-519d-456a-ac55-e8d9d5178eda, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-496cf8ca-d6e5-41ad-a902-2583d4faa7ec" returned: 0 in 0.635s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:25 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-quobyte-496cf8ca-d6e5-41ad-a902-2583d4faa7ec" released by "delete_volume" :: held 1.599s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda 1073741824" returned: 0 in 0.593s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda" returned: 0 in 0.300s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] <== create_volume: return (958ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc84de29-36a8-495c-b036-f85962f64572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7591cfd-519d-456a-ac55-e8d9d5178eda', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ae5ca5-6684-42eb-b9ed-93883f1e398a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Created reservations ['7a026c1a-a403-4536-80e9-a7efecf741f1', '52c8ba75-e466-4559-874a-24bf3000ca7c', '87354b60-57a7-4124-bf4e-d8a4fdacf79e', '07420131-8ed2-4de9-8362-8acfd3d46fd2'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:26 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume volume-c7591cfd-519d-456a-ac55-e8d9d5178eda (c7591cfd-519d-456a-ac55-e8d9d5178eda): created successfully
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ae5ca5-6684-42eb-b9ed-93883f1e398a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Flow 'volume_create_manager' (a5af11cd-ba03-46f3-af25-0e44adb5cc4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:26 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-d17e4b8c-c7e0-4d76-b6f2-95c48f2a6633 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Created volume successfully.
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.091s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:26 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:27 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Deleted volume successfully.
Sep 18 01:30:27 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-48ee665d-e418-49b8-a771-2fc3e82ac0b3 tempest-CreateVolumesFromSourceVolumeTest-452654386 None] Lock "cinder-496cf8ca-d6e5-41ad-a902-2583d4faa7ec-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:27 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:27 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:28 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] Creating offline snapshot 9418d60c-d5a4-4eb9-91b1-0a656267ef26 of volume c7591cfd-519d-456a-ac55-e8d9d5178eda {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:30:28 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbec90c-c5b3-443c-a6e7-5bd25932fc36]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:28 devstack quobyte-client[84147]: System call of process 101407 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:30:28 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda" returned: 0 in 0.793s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:29 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=162, name=volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:30:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26 1G" returned: 0 in 0.483s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c7591cfd-519d-456a-ac55-e8d9d5178eda -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "qemu-img rebase -u -b volume-c7591cfd-519d-456a-ac55-e8d9d5178eda -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26" returned: 0 in 0.252s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:29 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:30:29 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26" returned: 0 in 0.123s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:30:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26" returned: 0 in 0.132s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.info" returned: 0 in 0.149s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:30 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:30:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.info" returned: 0 in 0.159s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:30 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.713s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:31 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-64d717fc-58aa-4c8d-913d-94a133d7e4ae tempest-CreateVolumesFromSnapshotTest-2100692553 None] Create snapshot completed successfully
Sep 18 01:30:32 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Flow 'volume_create_manager' (3794ebc0-e60b-4e7c-afd4-0e08f903eefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df1133d-b16f-41e4-a5ac-8db15693dfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df1133d-b16f-41e4-a5ac-8db15693dfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2120253145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8d9a13-d617-4674-bd62-21bcff42909e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327d600395a7477fadce95c2f95a78e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:33Z,use_quota=True,user_id='50aedd1f8bb74607b07586824661d724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05d915b-c656-4f1d-930b-172b01f1c5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05d915b-c656-4f1d-930b-172b01f1c5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc74326a-9c4f-4b19-b667-832c4844a7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc74326a-9c4f-4b19-b667-832c4844a7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd8d9a13-d617-4674-bd62-21bcff42909e', 'volume_name': 'volume-cd8d9a13-d617-4674-bd62-21bcff42909e', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c98225-05d4-4ca8-acd8-b5eb90523ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c98225-05d4-4ca8-acd8-b5eb90523ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (802c1cfc-1be2-4b10-a61c-42cf170cf32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:33 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume cd8d9a13-d617-4674-bd62-21bcff42909e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd8d9a13-d617-4674-bd62-21bcff42909e', 'volume_size': 1}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2120253145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8d9a13-d617-4674-bd62-21bcff42909e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327d600395a7477fadce95c2f95a78e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:33Z,use_quota=True,user_id='50aedd1f8bb74607b07586824661d724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Creating volume cd8d9a13-d617-4674-bd62-21bcff42909e {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:30:33 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:30:33 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-cd8d9a13-d617-4674-bd62-21bcff42909e 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:33 devstack quobyte-client[84147]: System call of process 101445 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:30:33 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=164, name=volume-cd8d9a13-d617-4674-bd62-21bcff42909e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:30:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-cd8d9a13-d617-4674-bd62-21bcff42909e 1073741824" returned: 0 in 1.051s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:34 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-cd8d9a13-d617-4674-bd62-21bcff42909e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:34 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:34 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:30:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Flow 'volume_create_manager' (a2558e49-e078-4b57-a187-02b53775baef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:34 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7a4609-3a7c-4145-b438-3c82689350bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:35 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Flow 'volume_create_manager' (da78d162-cea4-42ed-9256-1123bc2b407f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a6c832-430b-4c41-aa1e-7d8609672901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a6c832-430b-4c41-aa1e-7d8609672901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2014229643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d99486-1126-4412-acbb-82b5240f6f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327d600395a7477fadce95c2f95a78e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:34Z,use_quota=True,user_id='50aedd1f8bb74607b07586824661d724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eca56a9-5388-48c9-8099-3fd0045de513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eca56a9-5388-48c9-8099-3fd0045de513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50f1b4c-691a-42f2-a1d0-391fdf0790ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50f1b4c-691a-42f2-a1d0-391fdf0790ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d99486-1126-4412-acbb-82b5240f6f78', 'volume_name': 'volume-50d99486-1126-4412-acbb-82b5240f6f78', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829ca014-e2f3-4573-959c-c64a4d795c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829ca014-e2f3-4573-959c-c64a4d795c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed99e76-94ab-4fb7-b5e7-5ba70e967069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:35 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume 50d99486-1126-4412-acbb-82b5240f6f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d99486-1126-4412-acbb-82b5240f6f78', 'volume_size': 1}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-cd8d9a13-d617-4674-bd62-21bcff42909e" returned: 0 in 0.973s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] <== create_volume: return (2074ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7a4609-3a7c-4145-b438-3c82689350bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2034264021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6b869b-580e-44aa-80de-05937f547186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327d600395a7477fadce95c2f95a78e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:33Z,use_quota=True,user_id='50aedd1f8bb74607b07586824661d724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cecdb86a-4be8-4298-a345-b63911d59ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cecdb86a-4be8-4298-a345-b63911d59ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8259ea51-5ea0-4939-894f-52e68008b636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8259ea51-5ea0-4939-894f-52e68008b636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b6b869b-580e-44aa-80de-05937f547186', 'volume_name': 'volume-4b6b869b-580e-44aa-80de-05937f547186', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3d51e4-2d1d-4828-89dd-5126b7064de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3d51e4-2d1d-4828-89dd-5126b7064de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed1272e-d291-4711-b402-7f502df27af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:35 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume 4b6b869b-580e-44aa-80de-05937f547186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b6b869b-580e-44aa-80de-05937f547186', 'volume_size': 1}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2034264021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6b869b-580e-44aa-80de-05937f547186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327d600395a7477fadce95c2f95a78e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:33Z,use_quota=True,user_id='50aedd1f8bb74607b07586824661d724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Creating volume 4b6b869b-580e-44aa-80de-05937f547186 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:30:35 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b6b869b-580e-44aa-80de-05937f547186 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:35 devstack quobyte-client[84147]: System call of process 101449 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:30:35 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=165, name=volume-4b6b869b-580e-44aa-80de-05937f547186, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (802c1cfc-1be2-4b10-a61c-42cf170cf32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd8d9a13-d617-4674-bd62-21bcff42909e', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:35 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf13d9c0-2b2c-4de3-8abd-b466e7c654f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:35 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Flow 'volume_create_manager' (288eabeb-45cf-4a09-a22b-46461ba11187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a81a4d-4dfb-46f2-975d-319c5635a73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:36 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Flow 'volume_create_manager' (f276fd3f-8eca-494f-b20a-140eaa7408a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615ef079-4a53-4fd2-83b4-22e17ecd5253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a81a4d-4dfb-46f2-975d-319c5635a73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f9b9e6-f795-4ca0-a67a-e77d0d39dee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69972143a1764876b5696accdd27578c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:35Z,use_quota=True,user_id='e40321f0562645529c415a9070ec1df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587a2e41-f0e4-4705-9400-f03dedd89375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587a2e41-f0e4-4705-9400-f03dedd89375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb97c1c-2c9a-481a-aea9-ead988da5d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.image.glance [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Creating Keystone auth plugin from conf {{(pid=84134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615ef079-4a53-4fd2-83b4-22e17ecd5253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801770918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6556b347-6206-4424-8791-430787d0ae68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327d600395a7477fadce95c2f95a78e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:35Z,use_quota=True,user_id='50aedd1f8bb74607b07586824661d724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff05963-9ffb-493d-91d0-f799d43c8fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff05963-9ffb-493d-91d0-f799d43c8fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc91bab1-c40d-4ce2-8179-1dd5a0d24a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc91bab1-c40d-4ce2-8179-1dd5a0d24a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6556b347-6206-4424-8791-430787d0ae68', 'volume_name': 'volume-6556b347-6206-4424-8791-430787d0ae68', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c35a4b2-cbe8-4a9d-a06c-651119a63495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c35a4b2-cbe8-4a9d-a06c-651119a63495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea057b1-aa5f-44eb-9ebd-3399ad7e98e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:36 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume 6556b347-6206-4424-8791-430787d0ae68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6556b347-6206-4424-8791-430787d0ae68', 'volume_size': 1}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:36 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume volume-cd8d9a13-d617-4674-bd62-21bcff42909e (cd8d9a13-d617-4674-bd62-21bcff42909e): created successfully
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf13d9c0-2b2c-4de3-8abd-b466e7c654f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Flow 'volume_create_manager' (3794ebc0-e60b-4e7c-afd4-0e08f903eefb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b6b869b-580e-44aa-80de-05937f547186 1073741824" returned: 0 in 1.048s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:36 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b6b869b-580e-44aa-80de-05937f547186 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:37 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5a5f5139-8791-4441-abfe-4e06843065e8 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Created volume successfully.
Sep 18 01:30:37 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Flow 'volume_create_manager' (7eca648e-86e2-4a5a-8feb-a7be6ebd0e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19990ca1-7d97-43ac-8e82-894cf8a81942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b6b869b-580e-44aa-80de-05937f547186" returned: 0 in 0.696s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] <== create_volume: return (1864ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.044s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2014229643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d99486-1126-4412-acbb-82b5240f6f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327d600395a7477fadce95c2f95a78e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:34Z,use_quota=True,user_id='50aedd1f8bb74607b07586824661d724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Creating volume 50d99486-1126-4412-acbb-82b5240f6f78 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:30:37 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:30:37 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-50d99486-1126-4412-acbb-82b5240f6f78 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:37 devstack quobyte-client[84147]: System call of process 101453 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:30:37 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=166, name=volume-50d99486-1126-4412-acbb-82b5240f6f78, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19990ca1-7d97-43ac-8e82-894cf8a81942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-49843757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594e15b7-8416-43a4-9be8-7e022c99d1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327d600395a7477fadce95c2f95a78e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:36Z,use_quota=True,user_id='50aedd1f8bb74607b07586824661d724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be911217-4af2-488f-8afe-cf8522c9a88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be911217-4af2-488f-8afe-cf8522c9a88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b16bca-166d-4d09-80e7-dc9cc27620dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b16bca-166d-4d09-80e7-dc9cc27620dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '594e15b7-8416-43a4-9be8-7e022c99d1d8', 'volume_name': 'volume-594e15b7-8416-43a4-9be8-7e022c99d1d8', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fe0340-6c52-4bd4-935c-99615213402a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fe0340-6c52-4bd4-935c-99615213402a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad58a9a-8b68-4cf7-a4e3-8c068338e258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:38 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume 594e15b7-8416-43a4-9be8-7e022c99d1d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-594e15b7-8416-43a4-9be8-7e022c99d1d8', 'volume_size': 1}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed1272e-d291-4711-b402-7f502df27af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b6b869b-580e-44aa-80de-05937f547186', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa24c039-656c-4902-8193-37add053d171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:38 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume volume-4b6b869b-580e-44aa-80de-05937f547186 (4b6b869b-580e-44aa-80de-05937f547186): created successfully
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa24c039-656c-4902-8193-37add053d171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Flow 'volume_create_manager' (a2558e49-e078-4b57-a187-02b53775baef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-50d99486-1126-4412-acbb-82b5240f6f78 1073741824" returned: 0 in 0.873s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb97c1c-2c9a-481a-aea9-ead988da5d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '19f9b9e6-f795-4ca0-a67a-e77d0d39dee6', 'volume_name': 'volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6', 'volume_size': 1, 'image_id': 'e7b6068a-5297-4b24-a3bc-35920261be1a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7b6068a-5297-4b24-a3bc-35920261be1a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '15e0e201afe44aafb84ba1d8d6240948', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69972143a1764876b5696accdd27578c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e2ac4cbd87df3a5ea88b2b622a6749b4d9b3e59376cc1908fec3289767a2119c37b59156f196920ab9e161c54d32ae80e50503d2d0c00e30c22f9b06b8038ef', 'id': 'e7b6068a-5297-4b24-a3bc-35920261be1a', 'created_at': datetime.datetime(2025, 9, 17, 23, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 23, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7b6068a-5297-4b24-a3bc-35920261be1a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a6769cf0>}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bea96ce-34e2-4080-8347-a5b1d51d2648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bea96ce-34e2-4080-8347-a5b1d51d2648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f040858-9161-4b5e-8112-52b1a5892046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:38 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Volume 19f9b9e6-f795-4ca0-a67a-e77d0d39dee6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6', 'volume_size': 1, 'image_id': 'e7b6068a-5297-4b24-a3bc-35920261be1a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7b6068a-5297-4b24-a3bc-35920261be1a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '15e0e201afe44aafb84ba1d8d6240948', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69972143a1764876b5696accdd27578c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e2ac4cbd87df3a5ea88b2b622a6749b4d9b3e59376cc1908fec3289767a2119c37b59156f196920ab9e161c54d32ae80e50503d2d0c00e30c22f9b06b8038ef', 'id': 'e7b6068a-5297-4b24-a3bc-35920261be1a', 'created_at': datetime.datetime(2025, 9, 17, 23, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 23, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7b6068a-5297-4b24-a3bc-35920261be1a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a6769cf0>}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Cloning 19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 from image e7b6068a-5297-4b24-a3bc-35920261be1a  at location (None, [{'url': 'file:///opt/stack/data/glance/images/e7b6068a-5297-4b24-a3bc-35920261be1a', 'metadata': {}}]). {{(pid=84134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-50d99486-1126-4412-acbb-82b5240f6f78 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:38 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-fce541be-c2ff-4410-8521-544527fc3761 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Created volume successfully.
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-50d99486-1126-4412-acbb-82b5240f6f78" returned: 0 in 0.477s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] <== create_volume: return (1417ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.498s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801770918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6556b347-6206-4424-8791-430787d0ae68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327d600395a7477fadce95c2f95a78e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:35Z,use_quota=True,user_id='50aedd1f8bb74607b07586824661d724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Creating volume 6556b347-6206-4424-8791-430787d0ae68 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:38 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:39 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:30:39 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:30:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6556b347-6206-4424-8791-430787d0ae68 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:39 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:SELECT=87,cinder:UPDATE=145,cinder:DELETE=19,cinder:INSERT=25 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:30:39 devstack quobyte-client[84147]: System call of process 101457 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:30:39 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=167, name=volume-6556b347-6206-4424-8791-430787d0ae68, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:30:39 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD, size 0.00 MB, duration 1.11 sec {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 01:30:39 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Image download 0.00 MB at 0.00 MB/s
Sep 18 01:30:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed99e76-94ab-4fb7-b5e7-5ba70e967069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d99486-1126-4412-acbb-82b5240f6f78', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:39 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1798bdd-20fa-4c50-bc43-deb0e0144a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:39 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=148,cinder:SELECT=98,cinder:DELETE=12,cinder:INSERT=31 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:30:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6556b347-6206-4424-8791-430787d0ae68 1073741824" returned: 0 in 0.708s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:39 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6556b347-6206-4424-8791-430787d0ae68 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[470a3cf0-137e-4868-99c1-291a385e180c]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:40 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume volume-50d99486-1126-4412-acbb-82b5240f6f78 (50d99486-1126-4412-acbb-82b5240f6f78): created successfully
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1798bdd-20fa-4c50-bc43-deb0e0144a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Flow 'volume_create_manager' (da78d162-cea4-42ed-9256-1123bc2b407f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:40 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-3bf9efbd-9c53-4911-8933-8710d52b2b18 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Created volume successfully.
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6556b347-6206-4424-8791-430787d0ae68" returned: 0 in 0.923s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] <== create_volume: return (1689ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.604s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-49843757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594e15b7-8416-43a4-9be8-7e022c99d1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327d600395a7477fadce95c2f95a78e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:36Z,use_quota=True,user_id='50aedd1f8bb74607b07586824661d724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Creating volume 594e15b7-8416-43a4-9be8-7e022c99d1d8 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:30:40 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:30:40 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-594e15b7-8416-43a4-9be8-7e022c99d1d8 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:40 devstack quobyte-client[84147]: System call of process 101462 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:30:40 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=168, name=volume-594e15b7-8416-43a4-9be8-7e022c99d1d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:30:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea057b1-aa5f-44eb-9ebd-3399ad7e98e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6556b347-6206-4424-8791-430787d0ae68', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799035c1-ba11-4ec3-90ee-c50e32add5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:41 devstack sudo[101461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD
Sep 18 01:30:41 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:30:41 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume volume-6556b347-6206-4424-8791-430787d0ae68 (6556b347-6206-4424-8791-430787d0ae68): created successfully
Sep 18 01:30:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799035c1-ba11-4ec3-90ee-c50e32add5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:41 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Flow 'volume_create_manager' (f276fd3f-8eca-494f-b20a-140eaa7408a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:41 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-4d6ba6c6-3904-46c7-8346-c97e209d1432 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Created volume successfully.
Sep 18 01:30:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-594e15b7-8416-43a4-9be8-7e022c99d1d8 1073741824" returned: 0 in 0.898s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-594e15b7-8416-43a4-9be8-7e022c99d1d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-594e15b7-8416-43a4-9be8-7e022c99d1d8" returned: 0 in 0.276s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:41 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] <== create_volume: return (1233ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:30:41 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad58a9a-8b68-4cf7-a4e3-8c068338e258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-594e15b7-8416-43a4-9be8-7e022c99d1d8', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ab97cb-af06-48b3-9138-81a530e24335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:42 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume volume-594e15b7-8416-43a4-9be8-7e022c99d1d8 (594e15b7-8416-43a4-9be8-7e022c99d1d8): created successfully
Sep 18 01:30:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ab97cb-af06-48b3-9138-81a530e24335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:42 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Flow 'volume_create_manager' (7eca648e-86e2-4a5a-8feb-a7be6ebd0e62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:42 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-4aef6b31-cd64-4d25-841c-2797f32da129 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Created volume successfully.
Sep 18 01:30:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-594e15b7-8416-43a4-9be8-7e022c99d1d8-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:42 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-594e15b7-8416-43a4-9be8-7e022c99d1d8-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:43 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-quobyte-594e15b7-8416-43a4-9be8-7e022c99d1d8" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:43 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-594e15b7-8416-43a4-9be8-7e022c99d1d8" acquired by "delete_volume" :: waited 0.044s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:43 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3653fc9c-61b0-4c04-8bf3-50adcd4e15cd]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-594e15b7-8416-43a4-9be8-7e022c99d1d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:43 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root
Sep 18 01:30:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD" returned: 0 in 3.343s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:43 devstack quobyte-client[84147]: System call of process 101470 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:30:43 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-594e15b7-8416-43a4-9be8-7e022c99d1d8" returned: 0 in 0.762s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-594e15b7-8416-43a4-9be8-7e022c99d1d8 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-594e15b7-8416-43a4-9be8-7e022c99d1d8" returned: 0 in 0.187s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:44 devstack sudo[101472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD
Sep 18 01:30:44 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:30:44 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-594e15b7-8416-43a4-9be8-7e022c99d1d8" released by "delete_volume" :: held 1.229s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:44 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Created reservations ['b2824f62-3008-4d0f-8218-3fbaed3deb6c', '99dbfff4-76c0-4480-9ae7-399f360d4323', '2c95164c-0d34-445b-b15e-14570e6975a0', '5937a828-6c6e-4282-80c4-4128942fc05b'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:44 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:44 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:44 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.263s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:45 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:45 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Deleted volume successfully.
Sep 18 01:30:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-6556b347-6206-4424-8791-430787d0ae68-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-6556b347-6206-4424-8791-430787d0ae68-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-5f26be63-0162-45a1-9266-b0ae21415189 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-594e15b7-8416-43a4-9be8-7e022c99d1d8-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:45 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-quobyte-6556b347-6206-4424-8791-430787d0ae68" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:45 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-6556b347-6206-4424-8791-430787d0ae68" acquired by "delete_volume" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:45 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4151af-274d-486b-bb20-51e8a31a02e2]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:45 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6556b347-6206-4424-8791-430787d0ae68 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:46 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root
Sep 18 01:30:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD" returned: 1 in 2.909s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:30:46 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Temporary image e7b6068a-5297-4b24-a3bc-35920261be1a is fetched for user e40321f0562645529c415a9070ec1df2. {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 01:30:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6556b347-6206-4424-8791-430787d0ae68" returned: 0 in 0.944s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:46 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6556b347-6206-4424-8791-430787d0ae68 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-6556b347-6206-4424-8791-430787d0ae68" returned: 0 in 0.230s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:47 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-6556b347-6206-4424-8791-430787d0ae68" released by "delete_volume" :: held 1.475s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:47 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd81973-91a6-4ea0-8605-9e05acdfd8bd]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:47 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Created reservations ['decf2750-ad0e-4fbe-b02b-68ef64271164', '480a07d0-8dc0-454d-98b4-169e998b9fd7', 'c81f2107-953a-42bd-9580-c3556fd51d07', '5d6d92ec-5e75-470a-a53f-4b4bf64a4f0a'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:47 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:47 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:48 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:48 devstack sudo[101485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD
Sep 18 01:30:48 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:30:48 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.180s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:48 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:48 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Deleted volume successfully.
Sep 18 01:30:48 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e13666b6-02e4-4e2b-96dc-6e3803edcc54 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-6556b347-6206-4424-8791-430787d0ae68-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:48 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-50d99486-1126-4412-acbb-82b5240f6f78-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:48 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-50d99486-1126-4412-acbb-82b5240f6f78-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:49 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:49 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-quobyte-50d99486-1126-4412-acbb-82b5240f6f78" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:49 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-50d99486-1126-4412-acbb-82b5240f6f78" acquired by "delete_volume" :: waited 0.021s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:49 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[597e624f-ccd7-49f9-b2e4-6d84c618c5c4]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:49 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-50d99486-1126-4412-acbb-82b5240f6f78 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:50 devstack quobyte-client[84147]: System call of process 101488 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:30:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-50d99486-1126-4412-acbb-82b5240f6f78" returned: 0 in 0.769s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-50d99486-1126-4412-acbb-82b5240f6f78 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:50 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root
Sep 18 01:30:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-50d99486-1126-4412-acbb-82b5240f6f78" returned: 0 in 0.283s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD" returned: 0 in 3.418s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:50 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:51 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-50d99486-1126-4412-acbb-82b5240f6f78" released by "delete_volume" :: held 1.515s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:51 devstack sudo[101494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD
Sep 18 01:30:51 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 01:30:51 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Created reservations ['14e4c797-5fa1-47d7-a2dd-07d235240159', 'e6b3c9af-1e09-4cf5-a844-a56c0e055549', '860a6a02-1a71-41c3-a364-b1d2c1ec1e6b', '6a373fb0-a19a-48fe-8226-bf99f8eb86f1'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:51 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:51 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.141s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:52 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:52 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Deleted volume successfully.
Sep 18 01:30:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-4b6b869b-580e-44aa-80de-05937f547186-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-160a3f7c-e7eb-4427-b1ae-24d762c6ae60 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-50d99486-1126-4412-acbb-82b5240f6f78-delete_volume" released by "delete_volume" :: held 3.766s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-4b6b869b-580e-44aa-80de-05937f547186-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:52 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-quobyte-4b6b869b-580e-44aa-80de-05937f547186" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:52 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-4b6b869b-580e-44aa-80de-05937f547186" acquired by "delete_volume" :: waited 0.027s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:53 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45edfda-9936-4b99-bcf7-426656fa150d]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:53 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b6b869b-580e-44aa-80de-05937f547186 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b6b869b-580e-44aa-80de-05937f547186" returned: 0 in 0.979s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b6b869b-580e-44aa-80de-05937f547186 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:54 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD" returned: 1 in 3.478s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f9b9e6-f795-4ca0-a67a-e77d0d39dee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69972143a1764876b5696accdd27578c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:35Z,use_quota=True,user_id='e40321f0562645529c415a9070ec1df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Creating volume 19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:30:54 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4b6b869b-580e-44aa-80de-05937f547186" returned: 0 in 0.337s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:54 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=169, name=volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-4b6b869b-580e-44aa-80de-05937f547186" released by "delete_volume" :: held 1.671s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 1073741824" returned: 0 in 0.545s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:54 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6" returned: 0 in 0.354s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:55 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] <== create_volume: return (961ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:30:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:55 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Attempting download of e7b6068a-5297-4b24-a3bc-35920261be1a ((None, [{'url': 'file:///opt/stack/data/glance/images/e7b6068a-5297-4b24-a3bc-35920261be1a', 'metadata': {}}])) to volume 19f9b9e6-f795-4ca0-a67a-e77d0d39dee6. {{(pid=84134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 01:30:55 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Created reservations ['cae9e21c-3bdf-40c1-b675-9618cbf4f270', '7c9d1899-0ba0-4ee1-8a1c-9ad41ab68c12', '037c4acb-4b00-4cf2-84f1-487c84d6185f', '3dcccec6-878d-46d5-a046-ed3acc9c4813'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:30:55 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe39f8-9375-43dc-ba40-afdbb3586a22]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:55 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7b6068a-5297-4b24-a3bc-35920261be1a_w9lg6par {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.053s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:56 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:56 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-cd8d9a13-d617-4674-bd62-21bcff42909e-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7b6068a-5297-4b24-a3bc-35920261be1a_w9lg6par" returned: 0 in 1.161s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:56 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7b6068a-5297-4b24-a3bc-35920261be1a_w9lg6par {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.742s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-cd8d9a13-d617-4674-bd62-21bcff42909e-delete_volume" acquired by "delete_volume" :: waited 0.361s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:57 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:57 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Deleted volume successfully.
Sep 18 01:30:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-8035e8c5-cbe1-45d1-af11-d798b7d63df9 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-4b6b869b-580e-44aa-80de-05937f547186-delete_volume" released by "delete_volume" :: held 4.788s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:30:57 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-quobyte-cd8d9a13-d617-4674-bd62-21bcff42909e" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:30:57 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-cd8d9a13-d617-4674-bd62-21bcff42909e" acquired by "delete_volume" :: waited 0.016s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:30:57 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d9a8da-547e-4aaf-a413-2ace44e125b0]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-cd8d9a13-d617-4674-bd62-21bcff42909e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7b6068a-5297-4b24-a3bc-35920261be1a_w9lg6par" returned: 1 in 0.878s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7b6068a-5297-4b24-a3bc-35920261be1a_w9lg6par' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:30:57 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b26a292-b88f-4686-a309-e1f65b11bfb5]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:30:57 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:58 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:30:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.180s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:58 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:30:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-cd8d9a13-d617-4674-bd62-21bcff42909e" returned: 0 in 1.065s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-cd8d9a13-d617-4674-bd62-21bcff42909e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD" returned: 0 in 1.130s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:59 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Flow 'volume_create_manager' (34481a41-a1a6-4507-88fc-b7a5677f4807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1daf01c1-2a3b-4478-b920-40994eee8515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-cd8d9a13-d617-4674-bd62-21bcff42909e" returned: 0 in 0.765s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1daf01c1-2a3b-4478-b920-40994eee8515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-945824875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a3a570-3588-49a3-8af3-09dad1039a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ae104a5fd249ac8593c634e5651403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:58Z,use_quota=True,user_id='2de9901f669340bb8ed23f89cbf50f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6608a7e-339b-4578-8700-62cf67bd0974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6608a7e-339b-4578-8700-62cf67bd0974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa4d9ea-8e36-47a9-8ea3-288b7f849e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa4d9ea-8e36-47a9-8ea3-288b7f849e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a3a570-3588-49a3-8af3-09dad1039a6e', 'volume_name': 'volume-20a3a570-3588-49a3-8af3-09dad1039a6e', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9bd2b04-e750-4978-a51c-cab1d803a532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9bd2b04-e750-4978-a51c-cab1d803a532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ee0711-c924-4792-b748-7fc67bfd6575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:30:59 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Volume 20a3a570-3588-49a3-8af3-09dad1039a6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a3a570-3588-49a3-8af3-09dad1039a6e', 'volume_size': 1}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff4b1b27e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-945824875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a3a570-3588-49a3-8af3-09dad1039a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ae104a5fd249ac8593c634e5651403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:30:58Z,use_quota=True,user_id='2de9901f669340bb8ed23f89cbf50f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)}" {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Creating volume 20a3a570-3588-49a3-8af3-09dad1039a6e {{(pid=84134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:30:59 devstack cinder-volume[84134]: INFO cinder.volume.drivers.remotefs [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] casted to 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e 1073741824 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:30:59 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=170, name=volume-20a3a570-3588-49a3-8af3-09dad1039a6e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:30:59 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-cd8d9a13-d617-4674-bd62-21bcff42909e" released by "delete_volume" :: held 2.128s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD" returned: 1 in 1.047s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] e7b6068a-5297-4b24-a3bc-35920261be1a was raw, converting to raw {{(pid=84134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e 1073741824" returned: 0 in 0.545s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:00 devstack quobyte-client[84147]: System call of process 101527 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:31:00 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=169, name=volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6" returned: 0 in 0.542s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e7b6068a-5297-4b24-a3bc-35920261be1a_s2cm9d2xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 {{(pid=84134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 01:31:00 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Converted 0.00 MB image at 0.00 MB/s
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e" returned: 0 in 0.396s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] <== create_volume: return (1226ms) {'provider_location': '10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'} {{(pid=84134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 1G" returned: 0 in 0.302s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ee0711-c924-4792-b748-7fc67bfd6575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a3a570-3588-49a3-8af3-09dad1039a6e', 'volume_size': 1}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:31:00 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189608eb-0253-4de3-a67c-bedf4ad78d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbfb6ca-3d71-426b-afcd-1cb6c4af7bfc]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Created reservations ['0586f38b-5b8d-44d2-8a25-a1b342a007fc', '61e7ab0d-8cb8-4ccc-8df7-19bf4c8ceab5', '90d62658-42ec-4dfe-af92-cac30879dd26', 'df09eb41-57d1-41ca-a112-d5a9c15bae8f'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:01 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Volume volume-20a3a570-3588-49a3-8af3-09dad1039a6e (20a3a570-3588-49a3-8af3-09dad1039a6e): created successfully
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189608eb-0253-4de3-a67c-bedf4ad78d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Flow 'volume_create_manager' (34481a41-a1a6-4507-88fc-b7a5677f4807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:31:01 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-0c90c0f1-7e12-4ad8-9a69-65a6118e0077 tempest-SnapshotDependencyTests-1010376833 None] Created volume successfully.
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6" returned: 0 in 0.659s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.292s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:01 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-9418d60c-d5a4-4eb9-91b1-0a656267ef26-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:02 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Deleted volume successfully.
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-78788377-b434-44dd-86ef-e621f4b0f4bc tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-cd8d9a13-d617-4674-bd62-21bcff42909e-delete_volume" released by "delete_volume" :: held 5.234s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-9418d60c-d5a4-4eb9-91b1-0a656267ef26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.267s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:02 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-quobyte-c7591cfd-519d-456a-ac55-e8d9d5178eda" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-c7591cfd-519d-456a-ac55-e8d9d5178eda" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-quobyte-9418d60c-d5a4-4eb9-91b1-0a656267ef26" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:02 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-9418d60c-d5a4-4eb9-91b1-0a656267ef26" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Deleting offline snapshot 9418d60c-d5a4-4eb9-91b1-0a656267ef26 of volume c7591cfd-519d-456a-ac55-e8d9d5178eda {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] snapshot_file for this snap is: volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26 {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba53c8dd-fefd-451b-8d85-deba11bb0b74]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:31:02 devstack quobyte-client[84147]: System call of process 101537 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] Creating offline snapshot 227bda7b-eb1f-4c29-90ad-051069997cee of volume 20a3a570-3588-49a3-8af3-09dad1039a6e {{(pid=84134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[004a18f2-9a14-41f1-a1e7-ff0e632e369a]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6" returned: 1 in 1.027s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Downloaded image e7b6068a-5297-4b24-a3bc-35920261be1a ((None, [{'url': 'file:///opt/stack/data/glance/images/e7b6068a-5297-4b24-a3bc-35920261be1a', 'metadata': {}}])) to volume 19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 successfully. {{(pid=84134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Temporary image e7b6068a-5297-4b24-a3bc-35920261be1a for user e40321f0562645529c415a9070ec1df2 is deleted. {{(pid=84134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 01:31:02 devstack cinder-volume[84134]: DEBUG cinder.volume.volume_utils [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Marking volume 19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 as bootable. {{(pid=84134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 01:31:03 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Copying metadata from image e7b6068a-5297-4b24-a3bc-35920261be1a to 19f9b9e6-f795-4ca0-a67a-e77d0d39dee6. {{(pid=84134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 01:31:03 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Creating volume glance metadata for volume 19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 backed by image e7b6068a-5297-4b24-a3bc-35920261be1a with: {'image_id': 'e7b6068a-5297-4b24-a3bc-35920261be1a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '15e0e201afe44aafb84ba1d8d6240948', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 01:31:03 devstack quobyte-client[84147]: System call of process 101540 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:31:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26" returned: 0 in 0.630s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:03 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7591cfd-519d-456a-ac55-e8d9d5178eda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:31:03 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a03c51-1ae1-486f-92c1-63ba53eb1a48]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:31:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e" returned: 0 in 0.915s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee 1G {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:03 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=171, name=volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:31:03 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda" returned: 0 in 0.766s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:04 devstack quobyte-client[84147]: System call of process 101553 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:31:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee 1G" returned: 0 in 0.614s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): qemu-img rebase -u -b volume-20a3a570-3588-49a3-8af3-09dad1039a6e -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:04 devstack quobyte-client[84147]: System call of process 101556 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:31:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f040858-9161-4b5e-8112-52b1a5892046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6', 'volume_size': 1, 'image_id': 'e7b6068a-5297-4b24-a3bc-35920261be1a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7b6068a-5297-4b24-a3bc-35920261be1a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '15e0e201afe44aafb84ba1d8d6240948', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69972143a1764876b5696accdd27578c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e2ac4cbd87df3a5ea88b2b622a6749b4d9b3e59376cc1908fec3289767a2119c37b59156f196920ab9e161c54d32ae80e50503d2d0c00e30c22f9b06b8038ef', 'id': 'e7b6068a-5297-4b24-a3bc-35920261be1a', 'created_at': datetime.datetime(2025, 9, 17, 23, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 23, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7b6068a-5297-4b24-a3bc-35920261be1a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff4a6769cf0>}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:31:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc8352b-9fdf-4702-b6c2-23405af6d179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:31:04 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Volume volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 (19f9b9e6-f795-4ca0-a67a-e77d0d39dee6): created successfully
Sep 18 01:31:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc8352b-9fdf-4702-b6c2-23405af6d179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:31:04 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Flow 'volume_create_manager' (288eabeb-45cf-4a09-a22b-46461ba11187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:31:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26" returned: 0 in 0.689s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] CMD "qemu-img rebase -u -b volume-20a3a570-3588-49a3-8af3-09dad1039a6e -F qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee" returned: 0 in 0.391s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:04 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:31:04 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:04 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b4e69d6e-8877-4217-9680-a5112cfb01e9 tempest-VolumeImageDependencyTests-1367152458 None] Created volume successfully.
Sep 18 01:31:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda.9418d60c-d5a4-4eb9-91b1-0a656267ef26" returned: 0 in 0.334s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee" returned: 0 in 0.286s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] Setting permissions: /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e -> 1000:1000 {{(pid=84134) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 01:31:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-9418d60c-d5a4-4eb9-91b1-0a656267ef26" released by "_delete_snapshot" :: held 2.834s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee" returned: 0 in 0.237s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:05 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-c7591cfd-519d-456a-ac55-e8d9d5178eda" released by "delete_snapshot" :: held 3.090s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.info" returned: 0 in 0.410s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:05 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.info is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:31:05 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.info {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Acquiring lock "cinder-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.info" returned: 0 in 0.441s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.845s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:31:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Lock "cinder-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6-delete_volume" acquired by "delete_volume" :: waited 0.185s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:06 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-8b17fdce-d7a6-4b6a-9c1a-8c8e951aff08 tempest-SnapshotDependencyTests-1010376833 None] Create snapshot completed successfully
Sep 18 01:31:06 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Created reservations ['f61ae86a-fd8a-44a9-b06b-9a98f826e15e', '50a76c41-9b50-4f63-8189-5f358e431073', '2a572591-8bed-4a35-873d-59ab174f8db5', '5c51e370-d334-4026-ae28-4841c8a17ac0'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:31:06 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:31:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Acquiring lock "cinder-quobyte-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Lock "cinder-quobyte-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6" acquired by "delete_volume" :: waited 0.017s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:06 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c085187d-082e-408c-b3b9-325ca67bd0fc]: (4, 'raw') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:31:06 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:06 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Delete snapshot completed successfully.
Sep 18 01:31:06 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-501b1e9c-7340-4b79-873e-c67377b414f2 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-9418d60c-d5a4-4eb9-91b1-0a656267ef26-delete_snapshot" released by "delete_snapshot" :: held 4.507s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6" returned: 0 in 0.484s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-c7591cfd-519d-456a-ac55-e8d9d5178eda-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6" returned: 1 in 0.598s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6' failed. Not Retrying. {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 01:31:07 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:07 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-c7591cfd-519d-456a-ac55-e8d9d5178eda-delete_volume" acquired by "delete_volume" :: waited 0.262s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6" returned: 0 in 0.413s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Lock "cinder-quobyte-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6" released by "delete_volume" :: held 1.683s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:08 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:31:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "cinder-quobyte-c7591cfd-519d-456a-ac55-e8d9d5178eda" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:08 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-c7591cfd-519d-456a-ac55-e8d9d5178eda" acquired by "delete_volume" :: waited 0.046s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:08 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc6c097-fcb1-493e-a2e9-ae48b5b5a5a1]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:31:08 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:08 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:31:08 devstack cinder-volume[84134]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 01:31:08 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Flow 'volume_create_manager' (9958e34a-48ee-49c5-82d5-bb8cc5d0f56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:31:08 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52feae1-56a2-4084-b4bb-78af1a00b7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:31:08 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Created reservations ['936ff2e0-0a9c-4f00-92bc-552ed8ea6822', '16d633af-d071-4004-b983-e7c32f58bd62', '2bbe1e33-e6c6-40a3-8e33-402399e2e5b6', '4efb6450-5e5f-4c90-993b-b2bf873d8d72'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda" returned: 0 in 0.679s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52feae1-56a2-4084-b4bb-78af1a00b7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T23:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4056a750-dba8-4f95-8640-6d8bae5f2d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ae104a5fd249ac8593c634e5651403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T23:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=227bda7b-eb1f-4c29-90ad-051069997cee,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T23:31:08Z,use_quota=True,user_id='2de9901f669340bb8ed23f89cbf50f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8),volume_type_id=4c41fdf3-e9b7-4bad-92f7-928e1bd8b2b8)' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58680c8f-58e2-482b-904c-cc17404fc026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58680c8f-58e2-482b-904c-cc17404fc026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85bb80b-4261-41b2-b0c4-54d43573c3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85bb80b-4261-41b2-b0c4-54d43573c3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4056a750-dba8-4f95-8640-6d8bae5f2d27', 'volume_name': 'volume-4056a750-dba8-4f95-8640-6d8bae5f2d27', 'volume_size': 1, 'snapshot_id': '227bda7b-eb1f-4c29-90ad-051069997cee'}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa5c50a-074f-43fd-bd56-c0a328cedd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa5c50a-074f-43fd-bd56-c0a328cedd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da40a7f-0c2a-40f7-9ba4-028c0ac1e01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:31:09 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Volume 4056a750-dba8-4f95-8640-6d8bae5f2d27: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4056a750-dba8-4f95-8640-6d8bae5f2d27', 'volume_size': 1, 'snapshot_id': '227bda7b-eb1f-4c29-90ad-051069997cee'}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-c7591cfd-519d-456a-ac55-e8d9d5178eda" returned: 0 in 0.486s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "cinder-quobyte-227bda7b-eb1f-4c29-90ad-051069997cee-4056a750-dba8-4f95-8640-6d8bae5f2d27" by "_create_volume_from_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-quobyte-c7591cfd-519d-456a-ac55-e8d9d5178eda" released by "delete_volume" :: held 1.343s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-quobyte-227bda7b-eb1f-4c29-90ad-051069997cee-4056a750-dba8-4f95-8640-6d8bae5f2d27" acquired by "_create_volume_from_snapshot" :: waited 0.162s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Creating volume 4056a750-dba8-4f95-8640-6d8bae5f2d27 from snapshot 227bda7b-eb1f-4c29-90ad-051069997cee {{(pid=84134) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Selected 10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876 as target Quobyte volume. {{(pid=84134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "cinder-quobyte-4056a750-dba8-4f95-8640-6d8bae5f2d27" by "_copy_volume_from_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-quobyte-4056a750-dba8-4f95-8640-6d8bae5f2d27" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] snapshot: 227bda7b-eb1f-4c29-90ad-051069997cee, volume: 4056a750-dba8-4f95-8640-6d8bae5f2d27,  {{(pid=84134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:31:09 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:31:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:31:10 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:31:10 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:31:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:31:10 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f98666-d107-497e-8b05-222d52e9266c]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:31:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:10 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Created reservations ['190380e6-7c7e-41ff-b2e1-a307c9a2a80f', '6be30a3c-c3bb-4d86-9411-96b69b34301c', '63260067-38bb-4972-aa6f-e0d546d40063', 'cd3b9512-bb5b-403c-848e-0eb375346688'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:31:10 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 1.098s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:10 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:31:11 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Deleted volume successfully.
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee" returned: 0 in 1.053s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20a3a570-3588-49a3-8af3-09dad1039a6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] will copy from snapshot at /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e {{(pid=84134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Creating direct copy from snapshot {{(pid=84134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b930dd1-dbf5-4238-9b51-8755ad60e0bc]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.453s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-d457fb75-13db-47c0-ba84-2a7ae5876cbc tempest-VolumeImageDependencyTests-1367152458 None] Lock "cinder-19f9b9e6-f795-4ca0-a67a-e77d0d39dee6-delete_volume" released by "delete_volume" :: held 5.522s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:11 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:31:12 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Deleted volume successfully.
Sep 18 01:31:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e" returned: 0 in 0.757s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:12 devstack cinder-volume[84134]: DEBUG cinder.utils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4056a750-dba8-4f95-8640-6d8bae5f2d27 not found in is_blk_device check {{(pid=84134) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 01:31:12 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4056a750-dba8-4f95-8640-6d8bae5f2d27 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:12 devstack quobyte-client[84147]: System call of process 101585 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 01:31:12 devstack quobyte-client[84147]: The server volume:4b65a7e5-5fec-405f-a51f-611d8e832cfc@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=4b65a7e5-5fec-405f-a51f-611d8e832cfc, inode=173, name=volume-4056a750-dba8-4f95-8640-6d8bae5f2d27, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.180), requestorAccessMask=0
Sep 18 01:31:12 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-691b4855-b92f-40bf-891f-c4aed8d21350 tempest-CreateVolumesFromSnapshotTest-2100692553 None] Lock "cinder-c7591cfd-519d-456a-ac55-e8d9d5178eda-delete_volume" released by "delete_volume" :: held 5.039s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4056a750-dba8-4f95-8640-6d8bae5f2d27" returned: 0 in 5.618s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:17 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef355fa-55ae-4202-8479-ef75ed057e7a]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:31:17 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e" returned: 0 in 0.515s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:18 devstack cinder-volume[84134]: DEBUG cinder.image.image_utils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Image conversion details: src /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4056a750-dba8-4f95-8640-6d8bae5f2d27 {{(pid=84134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 01:31:18 devstack cinder-volume[84134]: INFO cinder.image.image_utils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Converted 1024.00 MB image at 181.89 MB/s
Sep 18 01:31:18 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] File path /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4056a750-dba8-4f95-8640-6d8bae5f2d27 is being set with permissions: 660 {{(pid=84134) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 01:31:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4056a750-dba8-4f95-8640-6d8bae5f2d27 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4056a750-dba8-4f95-8640-6d8bae5f2d27" returned: 0 in 0.093s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:18 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-quobyte-4056a750-dba8-4f95-8640-6d8bae5f2d27" released by "_copy_volume_from_snapshot" :: held 8.929s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:18 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-quobyte-227bda7b-eb1f-4c29-90ad-051069997cee-4056a750-dba8-4f95-8640-6d8bae5f2d27" released by "_create_volume_from_snapshot" :: held 9.010s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:18 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.187s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:31:18 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da40a7f-0c2a-40f7-9ba4-028c0ac1e01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4056a750-dba8-4f95-8640-6d8bae5f2d27', 'volume_size': 1, 'snapshot_id': '227bda7b-eb1f-4c29-90ad-051069997cee'}' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:31:18 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d61b5fd-0aa1-43d3-9eef-9076d1f8476b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 01:31:19 devstack cinder-volume[84134]: INFO cinder.volume.flows.manager.create_volume [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Volume volume-4056a750-dba8-4f95-8640-6d8bae5f2d27 (4056a750-dba8-4f95-8640-6d8bae5f2d27): created successfully
Sep 18 01:31:19 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d61b5fd-0aa1-43d3-9eef-9076d1f8476b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84134) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 01:31:19 devstack cinder-volume[84134]: DEBUG cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Flow 'volume_create_manager' (9958e34a-48ee-49c5-82d5-bb8cc5d0f56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84134) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 01:31:19 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-bb948ec5-e268-4939-87c7-6d0b6836a7b5 tempest-SnapshotDependencyTests-1010376833 None] Created volume successfully.
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "cinder-227bda7b-eb1f-4c29-90ad-051069997cee-delete_snapshot" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-227bda7b-eb1f-4c29-90ad-051069997cee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:20 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "cinder-quobyte-20a3a570-3588-49a3-8af3-09dad1039a6e" by "delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-quobyte-20a3a570-3588-49a3-8af3-09dad1039a6e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "cinder-quobyte-227bda7b-eb1f-4c29-90ad-051069997cee" by "_delete_snapshot" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-quobyte-227bda7b-eb1f-4c29-90ad-051069997cee" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Deleting offline snapshot 227bda7b-eb1f-4c29-90ad-051069997cee of volume 20a3a570-3588-49a3-8af3-09dad1039a6e {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] snapshot_file for this snap is: volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee {{(pid=84134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf5d74e-80b0-49d4-b801-70d6b376b3fe]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee" returned: 0 in 0.356s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.remotefs [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20a3a570-3588-49a3-8af3-09dad1039a6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b867a5c3-77d3-4a8f-8cd4-02f509886b7a]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e" returned: 0 in 0.403s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:20 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee" returned: 0 in 0.179s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:21 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e.227bda7b-eb1f-4c29-90ad-051069997cee" returned: 0 in 0.106s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:21 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-quobyte-227bda7b-eb1f-4c29-90ad-051069997cee" released by "_delete_snapshot" :: held 1.330s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:21 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-quobyte-20a3a570-3588-49a3-8af3-09dad1039a6e" released by "delete_snapshot" :: held 1.349s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:21 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Created reservations ['7cfba81a-be6e-456b-8fb5-8f05f46eccbf', '353fe722-dc63-41f7-9047-ab91fa1d1daf', 'cecea00e-d951-446b-bd35-5a6e46a22d59', '66b14c35-6753-4bd5-ae7e-b98e1cc23134'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:31:21 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Delete snapshot completed successfully.
Sep 18 01:31:21 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-b809e621-7cf7-4d16-9889-e638968c7410 tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-227bda7b-eb1f-4c29-90ad-051069997cee-delete_snapshot" released by "delete_snapshot" :: held 1.778s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:22 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "cinder-20a3a570-3588-49a3-8af3-09dad1039a6e-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:22 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-20a3a570-3588-49a3-8af3-09dad1039a6e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:22 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:31:22 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "cinder-quobyte-20a3a570-3588-49a3-8af3-09dad1039a6e" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:22 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-quobyte-20a3a570-3588-49a3-8af3-09dad1039a6e" acquired by "delete_volume" :: waited 0.009s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:22 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ede3047-860b-4e2a-b4a8-dc526af0918b]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:31:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e" returned: 0 in 0.411s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:22 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-20a3a570-3588-49a3-8af3-09dad1039a6e" returned: 0 in 0.109s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:23 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-quobyte-20a3a570-3588-49a3-8af3-09dad1039a6e" released by "delete_volume" :: held 0.684s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:23 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Created reservations ['191ee614-b242-40a6-abaf-d6bb4197dfdc', 'bc6feb2c-cdce-4324-bfef-84dc1627d5c8', 'b5898023-4eec-4a17-a94a-96fabfdc2823', '4381ed55-5e2b-4d0d-ad17-94c1cb2beb47'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:31:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:31:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:31:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:31:23 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:31:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:31:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:23 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.099s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:23 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:31:23 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Deleted volume successfully.
Sep 18 01:31:23 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-441c798a-73fd-48f3-849f-8fa4b4f765ac tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-20a3a570-3588-49a3-8af3-09dad1039a6e-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "cinder-4056a750-dba8-4f95-8640-6d8bae5f2d27-delete_volume" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-4056a750-dba8-4f95-8640-6d8bae5f2d27-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:24 devstack cinder-volume[84134]: WARNING cinder.volume.volume_utils [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 01:31:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "cinder-quobyte-4056a750-dba8-4f95-8640-6d8bae5f2d27" by "delete_volume" {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 01:31:24 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-quobyte-4056a750-dba8-4f95-8640-6d8bae5f2d27" acquired by "delete_volume" :: waited 0.011s {{(pid=84134) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 01:31:24 devstack cinder-volume[84134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f89fed7-4e51-49cb-aedf-f9f60191cb4a]: (4, 'qcow2') {{(pid=84457) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 01:31:24 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4056a750-dba8-4f95-8640-6d8bae5f2d27 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4056a750-dba8-4f95-8640-6d8bae5f2d27" returned: 0 in 0.385s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4056a750-dba8-4f95-8640-6d8bae5f2d27 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] CMD "rm -f /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046/volume-4056a750-dba8-4f95-8640-6d8bae5f2d27" returned: 0 in 0.088s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:25 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-quobyte-4056a750-dba8-4f95-8640-6d8bae5f2d27" released by "delete_volume" :: held 0.635s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:25 devstack cinder-volume[84134]: DEBUG cinder.quota [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Created reservations ['6a70fa42-c928-4880-b234-2e63c42a5f23', '97584fd3-3f45-4036-80b0-a11e7998fac9', 'b955354c-67a4-4045-b740-db8fcf163664', '760e2208-3378-424d-ae27-c91bfd396431'] {{(pid=84134) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 01:31:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:31:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:31:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:31:25 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:31:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:31:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:25 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.106s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:25 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 01:31:25 devstack cinder-volume[84134]: INFO cinder.volume.manager [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Deleted volume successfully.
Sep 18 01:31:26 devstack cinder-volume[84134]: DEBUG cinder.coordination [None req-e24d5cc4-2d52-4c0e-9849-e8f573a1dbec tempest-SnapshotDependencyTests-1010376833 None] Lock "cinder-4056a750-dba8-4f95-8640-6d8bae5f2d27-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=84134) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 01:31:35 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:UPDATE=99,cinder:DELETE=5,cinder:SELECT=62,cinder:INSERT=29 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:31:36 devstack cinder-volume[84134]: DEBUG dbcounter [-] [84134] Writing DB stats cinder:DELETE=11,cinder:UPDATE=91,cinder:SELECT=68,cinder:INSERT=24 {{(pid=84134) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 01:31:58 devstack cinder-volume[84134]: DEBUG oslo_service.periodic_task [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84134) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 01:31:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 01:31:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 01:31:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876': None} {{(pid=84134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 01:31:58 devstack cinder-volume[84134]: DEBUG cinder.volume.drivers.quobyte [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Available shares ['10.10.41.181/cinder-vol-c513c359-6067-46be-b24c-afa295ac1876'] {{(pid=84134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 01:31:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.lockutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84134) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 01:31:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046 {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 01:31:58 devstack cinder-volume[84134]: DEBUG oslo_concurrency.processutils [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/292faa1e4a137d8f1454d630d9fec046" returned: 0 in 0.108s {{(pid=84134) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 01:31:58 devstack cinder-volume[84134]: DEBUG cinder.manager [None req-fb45da1b-c929-46ef-962d-a96f465f4262 None None] Notifying Schedulers of capabilities ... {{(pid=84134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}